D 2024-02-03 23:03:26.007506+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-03-22-30-57')]
I 2024-02-03 23:03:26.086983+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-03 23:03:26.087367+00:00 Last poll: https://brid.gy/log?start_time=1706999457&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-03 23:03:26.178024+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 3, 23, 3, 26, 87488, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-03 23:03:26.297571+00:00 no refresh_token
I 2024-02-03 23:03:26.323234+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-03 23:03:27.401085+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-03 23:03:27.405223+00:00 Received 200
I 2024-02-03 23:03:27.411163+00:00 requests.get https://social.lol/api/v1/statuses/111870039623878995/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-03 23:03:27.731609+00:00 Received 200
I 2024-02-03 23:03:27.893833+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-03 23:03:28.891951+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-03 23:03:28.894708+00:00 Received 200
I 2024-02-03 23:03:28.992377+00:00 Found 61 public activities: dict_keys(['tag:social.lol,2013:111870039623878995', 'tag:social.lol,2013:111869530527960926', 'tag:social.lol,2013:111869335983852389', 'tag:social.lol,2013:111869083274350835', 'tag:social.lol,2013:111868216023616527', 'tag:social.lol,2013:111868175416344655', 'tag:social.lol,2013:111865560052012657', 'tag:social.lol,2013:111865407975933361', 'tag:social.lol,2013:111865176050478197', 'tag:social.lol,2013:111864959875474802', 'tag:social.lol,2013:111864781629337143', 'tag:social.lol,2013:111864779906814721', 'tag:social.lol,2013:111864763522246546', 'tag:social.lol,2013:111864746481408057', 'tag:social.lol,2013:111864745161333068', 'tag:social.lol,2013:111864700481313009', 'tag:social.lol,2013:111864691514733096', 'tag:social.lol,2013:111864667467498567', 'tag:social.lol,2013:111864663372807033', 'tag:social.lol,2013:111864662597656303', 'tag:social.lol,2013:111864632238199359', 'tag:social.lol,2013:111864627746350418', 'tag:social.lol,2013:111864624529535318', 'tag:social.lol,2013:111864623545986653', 'tag:social.lol,2013:111864579073183580', 'tag:social.lol,2013:111864440144334979', 'tag:social.lol,2013:111870030146759538', 'tag:social.lol,2013:111869869543527792', 'tag:social.lol,2013:111869544832782431', 'tag:social.lol,2013:111869527656369574', 'tag:social.lol,2013:111866545579243246', 'tag:social.lol,2013:111866468331550273', 'tag:social.lol,2013:111866225648013110', 'tag:social.lol,2013:111864629470699094', 'tag:social.lol,2013:111864481785181611', 'tag:social.lol,2013:111864435141777584', 'tag:social.lol,2013:111864404647934446', 'tag:social.lol,2013:111864400087849382', 'tag:social.lol,2013:111864365259191108', 'tag:social.lol,2013:111864360204521652', 'tag:social.lol,2013:111864355239266685', 'tag:social.lol,2013:111864342867611726', 'tag:social.lol,2013:111864334291810392', 'tag:social.lol,2013:111864333575593832', 'tag:social.lol,2013:111864328321729050', 'tag:social.lol,2013:111864302489804514', 'tag:social.lol,2013:111864302341125832', 'tag:social.lol,2013:111864288860708215', 'tag:social.lol,2013:111864284841995943', 'tag:social.lol,2013:111864280477627744', 'tag:social.lol,2013:111864155402600303', 'tag:social.lol,2013:111863977623661813', 'tag:social.lol,2013:111863972673821833', 'tag:social.lol,2013:111863972184569730', 'tag:social.lol,2013:111863963492611200', 'tag:social.lol,2013:111863850712504173', 'tag:social.lol,2013:111863834689605234', 'tag:social.lol,2013:111863711109236979', 'tag:social.lol,2013:111863587905655100', 'tag:social.lol,2013:111863552220711121', 'tag:social.lol,2013:111863544821657700'])
I 2024-02-03 23:03:28.992605+00:00 Found 9 private activities: dict_keys(['tag:social.lol,2013:111864478115372424', 'tag:social.lol,2013:111864468102969543', 'tag:social.lol,2013:111864427752456511', 'tag:social.lol,2013:111864417865139272', 'tag:social.lol,2013:111864471898030329', 'tag:social.lol,2013:111864462082561632', 'tag:social.lol,2013:111864425625042443', 'tag:social.lol,2013:111864411180791362', 'tag:social.lol,2013:111864409378921526'])
D 2024-02-03 23:03:28.995066+00:00 discovering original posts for: https://social.lol/@cory/111870039623878995
I 2024-02-03 23:03:28.995352+00:00 requests.head https://wandering.shop/@NateBarham {'headers': {}}
I 2024-02-03 23:03:29.650136+00:00 Received 200
I 2024-02-03 23:03:29.650432+00:00 Original post discovery found original posts set(), mentions {'https://wandering.shop/@NateBarham'}
I 2024-02-03 23:03:29.650718+00:00 requests.head https://social.lol/@cory/111870039623878995 {'headers': None}
I 2024-02-03 23:03:29.958132+00:00 Received 200
I 2024-02-03 23:03:29.958734+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111870039623878995
I 2024-02-03 23:03:30.003449+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-03 23:03:30.281098+00:00 Received 200
D 2024-02-03 23:03:30.282196+00:00 fetching author url https://coryd.dev/
I 2024-02-03 23:03:30.282423+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 23:03:30.520612+00:00 Received 200
D 2024-02-03 23:03:30.531841+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-03 23:03:30.532333+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.532472+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.532574+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.532672+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.532771+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.532909+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.533083+00:00 ignoring h-entry with no u-url!
D 2024-02-03 23:03:30.533174+00:00 ignoring h-entry with no u-url!
I 2024-02-03 23:03:30.533366+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-03 23:03:30.559324+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3edba0369990>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-03 23:03:30.559936+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-03 23:03:30.561309+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-03 23:03:30.561480+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-03 23:03:30.566112+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3edba8087790>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3edba8087790>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3edba8087790>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-03 23:03:30.578283+00:00 posse post discovery found no relationship for https://social.lol/@cory/111870039623878995
I 2024-02-03 23:03:30.862848+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-03 23:03:30.886296+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 3, 23, 2, 17, 34000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 3, 23, 3, 26, 87488, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-03 23:03:30.994735+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/62969341312266567141 with ETA 1707003264: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-03-23-03-26', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707003264
}