D 2024-02-03 20:25:57.006386+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-03-19-59-11')]
I 2024-02-03 20:25:57.032315+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-03 20:25:57.032650+00:00 Last poll: https://brid.gy/log?start_time=1706990351&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-03 20:25:57.056381+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 3, 20, 25, 57, 32750, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-03 20:25:57.152795+00:00 no refresh_token
I 2024-02-03 20:25:57.177038+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-03 20:25:58.368070+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-03 20:25:58.371516+00:00 Received 200
I 2024-02-03 20:25:58.377874+00:00 requests.get https://social.lol/api/v1/statuses/111869335983852389/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-03 20:25:58.626716+00:00 Received 200
I 2024-02-03 20:25:58.629036+00:00 requests.get https://social.lol/api/v1/statuses/111869335983852389/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-03 20:25:58.855041+00:00 Received 200
I 2024-02-03 20:25:58.892685+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-03 20:25:59.830952+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-03 20:25:59.834562+00:00 Received 200
I 2024-02-03 20:25:59.903764+00:00 Found 61 public activities: dict_keys(['tag:social.lol,2013:111869335983852389', 'tag:social.lol,2013:111869083274350835', 'tag:social.lol,2013:111868216023616527', 'tag:social.lol,2013:111868175416344655', 'tag:social.lol,2013:111865560052012657', 'tag:social.lol,2013:111865407975933361', 'tag:social.lol,2013:111865176050478197', 'tag:social.lol,2013:111864959875474802', 'tag:social.lol,2013:111864781629337143', 'tag:social.lol,2013:111864779906814721', 'tag:social.lol,2013:111864763522246546', 'tag:social.lol,2013:111864746481408057', 'tag:social.lol,2013:111864745161333068', 'tag:social.lol,2013:111864700481313009', 'tag:social.lol,2013:111864691514733096', 'tag:social.lol,2013:111864667467498567', 'tag:social.lol,2013:111864663372807033', 'tag:social.lol,2013:111864662597656303', 'tag:social.lol,2013:111864632238199359', 'tag:social.lol,2013:111864627746350418', 'tag:social.lol,2013:111864624529535318', 'tag:social.lol,2013:111864623545986653', 'tag:social.lol,2013:111864579073183580', 'tag:social.lol,2013:111864440144334979', 'tag:social.lol,2013:111864408396126129', 'tag:social.lol,2013:111864402448384676', 'tag:social.lol,2013:111866545579243246', 'tag:social.lol,2013:111866468331550273', 'tag:social.lol,2013:111866225648013110', 'tag:social.lol,2013:111864629470699094', 'tag:social.lol,2013:111864481785181611', 'tag:social.lol,2013:111864435141777584', 'tag:social.lol,2013:111864404647934446', 'tag:social.lol,2013:111864400087849382', 'tag:social.lol,2013:111864365259191108', 'tag:social.lol,2013:111864360204521652', 'tag:social.lol,2013:111864355239266685', 'tag:social.lol,2013:111864342867611726', 'tag:social.lol,2013:111864334291810392', 'tag:social.lol,2013:111864333575593832', 'tag:social.lol,2013:111864328321729050', 'tag:social.lol,2013:111864302489804514', 'tag:social.lol,2013:111864302341125832', 'tag:social.lol,2013:111864288860708215', 'tag:social.lol,2013:111864284841995943', 'tag:social.lol,2013:111864280477627744', 'tag:social.lol,2013:111864155402600303', 'tag:social.lol,2013:111863977623661813', 'tag:social.lol,2013:111863972673821833', 'tag:social.lol,2013:111863972184569730', 'tag:social.lol,2013:111863963492611200', 'tag:social.lol,2013:111863850712504173', 'tag:social.lol,2013:111863834689605234', 'tag:social.lol,2013:111863711109236979', 'tag:social.lol,2013:111863587905655100', 'tag:social.lol,2013:111863552220711121', 'tag:social.lol,2013:111863544821657700', 'tag:social.lol,2013:111863501683861492', 'tag:social.lol,2013:111863494818212362', 'tag:social.lol,2013:111863488100227322', 'tag:social.lol,2013:111863445598544213'])
I 2024-02-03 20:25:59.903997+00:00 Found 9 private activities: dict_keys(['tag:social.lol,2013:111864478115372424', 'tag:social.lol,2013:111864468102969543', 'tag:social.lol,2013:111864427752456511', 'tag:social.lol,2013:111864417865139272', 'tag:social.lol,2013:111864471898030329', 'tag:social.lol,2013:111864462082561632', 'tag:social.lol,2013:111864425625042443', 'tag:social.lol,2013:111864411180791362', 'tag:social.lol,2013:111864409378921526'])
D 2024-02-03 20:25:59.907997+00:00 discovering original posts for: https://social.lol/@cory/111869335983852389
I 2024-02-03 20:25:59.908932+00:00 requests.head https://app.thestorygraph.com/books/7c30a431-70e0-4efd-a585-56df0babfc7c {'headers': {}}
I 2024-02-03 20:26:00.461618+00:00 Received 200
I 2024-02-03 20:26:00.461983+00:00 requests.head https://social.lol/tags/Books {'headers': {'User-Agent': '...'}}
I 2024-02-03 20:26:00.671187+00:00 Received 200
I 2024-02-03 20:26:00.671558+00:00 requests.head https://social.lol/tags/NowReading {'headers': {'User-Agent': '...'}}
I 2024-02-03 20:26:00.877975+00:00 Received 200
I 2024-02-03 20:26:00.878335+00:00 requests.head https://social.lol/tags/TheStoryGraph {'headers': {'User-Agent': '...'}}
I 2024-02-03 20:26:01.145379+00:00 Received 200
I 2024-02-03 20:26:01.145782+00:00 Original post discovery found original posts set(), mentions {'https://social.lol/tags/NowReading', 'https://app.thestorygraph.com/books/7c30a431-70e0-4efd-a585-56df0babfc7c', 'https://social.lol/tags/TheStoryGraph', 'https://social.lol/tags/Books'}
I 2024-02-03 20:26:01.148981+00:00 requests.head https://social.lol/@cory/111869335983852389 {'headers': None}
I 2024-02-03 20:26:01.467295+00:00 Received 200
I 2024-02-03 20:26:01.467658+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111869335983852389
I 2024-02-03 20:26:01.573798+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-03 20:26:01.881489+00:00 Received 200
D 2024-02-03 20:26:01.882596+00:00 fetching author url https://coryd.dev/
I 2024-02-03 20:26:01.882836+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 20:26:02.191350+00:00 Received 200
D 2024-02-03 20:26:02.244601+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-03 20:26:02.245152+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245283+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245387+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245480+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245569+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245661+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245757+00:00 ignoring h-entry with no u-url!
D 2024-02-03 20:26:02.245842+00:00 ignoring h-entry with no u-url!
I 2024-02-03 20:26:02.246062+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-03 20:26:02.270429+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e1baebb7550>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-03 20:26:02.270698+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-03 20:26:02.271808+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-03 20:26:02.272030+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 20:26:02.278438+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3e1bae1f0550>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e1bae1f0550>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e1bae1f0550>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-03 20:26:02.322737+00:00 posse post discovery found no relationship for https://social.lol/@cory/111869335983852389
I 2024-02-03 20:26:02.713226+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-03 20:26:02.739885+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 3, 20, 3, 20, 340000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 3, 20, 25, 57, 32750, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-03 20:26:02.856759+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/80686126184955795281 with ETA 1706993844: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-03-20-25-57', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1706993844
}