D 2024-02-03 23:34:24.006254+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-03-23-03-26')]
I 2024-02-03 23:34:24.026273+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-03 23:34:24.026563+00:00 Last poll: https://brid.gy/log?start_time=1707001406&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-03 23:34:24.041261+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 3, 23, 34, 24, 26653, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-03 23:34:24.125805+00:00 no refresh_token
I 2024-02-03 23:34:24.142490+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:24.855602+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-03 23:34:24.858256+00:00 Received 200
I 2024-02-03 23:34:24.862803+00:00 requests.get https://social.lol/api/v1/statuses/111870100884574401/context {'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:25.107265+00:00 Received 200
I 2024-02-03 23:34:25.110695+00:00 requests.get https://social.lol/api/v1/statuses/111870100884574401/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:25.378220+00:00 Received 200
I 2024-02-03 23:34:25.383155+00:00 requests.get https://social.lol/api/v1/statuses/111870054052824312/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:25.652228+00:00 Received 200
I 2024-02-03 23:34:25.655325+00:00 requests.get https://social.lol/api/v1/statuses/111870039623878995/context {'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:25.953415+00:00 Received 200
I 2024-02-03 23:34:25.983815+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-03 23:34:27.224475+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-03 23:34:27.227558+00:00 Received 200
I 2024-02-03 23:34:27.287535+00:00 Found 63 public activities: dict_keys(['tag:social.lol,2013:111870100884574401', 'tag:social.lol,2013:111870093573444487', 'tag:social.lol,2013:111870054052824312', 'tag:social.lol,2013:111870039623878995', 'tag:social.lol,2013:111869530527960926', 'tag:social.lol,2013:111869335983852389', 'tag:social.lol,2013:111869083274350835', 'tag:social.lol,2013:111868216023616527', 'tag:social.lol,2013:111868175416344655', 'tag:social.lol,2013:111865560052012657', 'tag:social.lol,2013:111865407975933361', 'tag:social.lol,2013:111865176050478197', 'tag:social.lol,2013:111864959875474802', 'tag:social.lol,2013:111864781629337143', 'tag:social.lol,2013:111864779906814721', 'tag:social.lol,2013:111864763522246546', 'tag:social.lol,2013:111864746481408057', 'tag:social.lol,2013:111864745161333068', 'tag:social.lol,2013:111864700481313009', 'tag:social.lol,2013:111864691514733096', 'tag:social.lol,2013:111864667467498567', 'tag:social.lol,2013:111864663372807033', 'tag:social.lol,2013:111864662597656303', 'tag:social.lol,2013:111864632238199359', 'tag:social.lol,2013:111864627746350418', 'tag:social.lol,2013:111864624529535318', 'tag:social.lol,2013:111864623545986653', 'tag:social.lol,2013:111864579073183580', 'tag:social.lol,2013:111870161696396188', 'tag:social.lol,2013:111870127303631543', 'tag:social.lol,2013:111870114426388423', 'tag:social.lol,2013:111870056244582260', 'tag:social.lol,2013:111870048942583729', 'tag:social.lol,2013:111870030146759538', 'tag:social.lol,2013:111869869543527792', 'tag:social.lol,2013:111869544832782431', 'tag:social.lol,2013:111869527656369574', 'tag:social.lol,2013:111866545579243246', 'tag:social.lol,2013:111866468331550273', 'tag:social.lol,2013:111866225648013110', 'tag:social.lol,2013:111864629470699094', 'tag:social.lol,2013:111864481785181611', 'tag:social.lol,2013:111864435141777584', 'tag:social.lol,2013:111864404647934446', 'tag:social.lol,2013:111864400087849382', 'tag:social.lol,2013:111864365259191108', 'tag:social.lol,2013:111864360204521652', 'tag:social.lol,2013:111864355239266685', 'tag:social.lol,2013:111864342867611726', 'tag:social.lol,2013:111864334291810392', 'tag:social.lol,2013:111864333575593832', 'tag:social.lol,2013:111864328321729050', 'tag:social.lol,2013:111864302489804514', 'tag:social.lol,2013:111864302341125832', 'tag:social.lol,2013:111864288860708215', 'tag:social.lol,2013:111864284841995943', 'tag:social.lol,2013:111864280477627744', 'tag:social.lol,2013:111864155402600303', 'tag:social.lol,2013:111863977623661813', 'tag:social.lol,2013:111863972673821833', 'tag:social.lol,2013:111863972184569730', 'tag:social.lol,2013:111863963492611200', 'tag:social.lol,2013:111863850712504173'])
I 2024-02-03 23:34:27.287782+00:00 Found 7 private activities: dict_keys(['tag:social.lol,2013:111864478115372424', 'tag:social.lol,2013:111864468102969543', 'tag:social.lol,2013:111864471898030329', 'tag:social.lol,2013:111864462082561632', 'tag:social.lol,2013:111864425625042443', 'tag:social.lol,2013:111864411180791362', 'tag:social.lol,2013:111864409378921526'])
D 2024-02-03 23:34:27.292604+00:00 discovering original posts for: https://social.lol/@cory/111870100884574401
I 2024-02-03 23:34:27.292807+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-03 23:34:27.293167+00:00 requests.head https://social.lol/@cory/111870100884574401 {'headers': None}
I 2024-02-03 23:34:27.565789+00:00 Received 200
I 2024-02-03 23:34:27.566138+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111870100884574401
I 2024-02-03 23:34:27.593582+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-03 23:34:27.913760+00:00 Received 200
D 2024-02-03 23:34:27.914739+00:00 fetching author url https://coryd.dev/
I 2024-02-03 23:34:27.914867+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 23:34:28.109953+00:00 Received 200
D 2024-02-03 23:34:28.126062+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-03 23:34:28.126593+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.126734+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.126847+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.126963+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.127084+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.127182+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.127274+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:34:28.127370+00:00 ignoring h-entry with no u-url!
I 2024-02-03 23:34:28.127570+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-03 23:34:28.151537+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e4462b6aa10>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-03 23:34:28.151823+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-03 23:34:28.152795+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-03 23:34:28.153003+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 23:34:28.157683+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3e4462169c10>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e4462169c10>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e4462169c10>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-03 23:34:28.183099+00:00 posse post discovery found no relationship for https://social.lol/@cory/111870100884574401
D 2024-02-03 23:34:28.813766+00:00 discovering original posts for: https://social.lol/@cory/111870054052824312
I 2024-02-03 23:34:28.814214+00:00 requests.head https://wandering.shop/@NateBarham {'headers': {}}
I 2024-02-03 23:34:29.158805+00:00 Received 200
I 2024-02-03 23:34:29.159195+00:00 Original post discovery found original posts set(), mentions {'https://wandering.shop/@NateBarham'}
I 2024-02-03 23:34:29.159464+00:00 requests.head https://social.lol/@cory/111870054052824312 {'headers': None}
I 2024-02-03 23:34:29.439700+00:00 Received 200
I 2024-02-03 23:34:29.440021+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111870054052824312
D 2024-02-03 23:34:29.467720+00:00 skipping https://coryd.dev/, already fetched this round
D 2024-02-03 23:34:29.467919+00:00 skipping https://blog.coryd.dev/, already fetched this round
D 2024-02-03 23:34:29.468016+00:00 posse post discovery found no relationship for https://social.lol/@cory/111870054052824312
D 2024-02-03 23:34:29.657526+00:00 discovering original posts for: https://social.lol/@cory/111870039623878995
I 2024-02-03 23:34:29.657952+00:00 Original post discovery found original posts set(), mentions {'https://wandering.shop/@NateBarham'}
I 2024-02-03 23:34:29.658204+00:00 requests.head https://social.lol/@cory/111870039623878995 {'headers': None}
I 2024-02-03 23:34:29.868802+00:00 Received 200
I 2024-02-03 23:34:29.869122+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111870039623878995
I 2024-02-03 23:34:30.066730+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-03 23:34:30.086291+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 3, 23, 33, 19), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 3, 23, 34, 24, 26653, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-03 23:34:30.387695+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/73927416739561175701 with ETA 1707004794: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-03-23-34-24', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707004794
}