D 2024-02-10 18:58:27.007058+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-10-18-30-21')]
I 2024-02-10 18:58:27.028289+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-10 18:58:27.028667+00:00 Last poll: https://brid.gy/log?start_time=1707589821&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-10 18:58:27.061344+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 10, 18, 58, 27, 28812, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-10 18:58:27.316054+00:00 no refresh_token
I 2024-02-10 18:58:27.342873+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:28.459495+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-10 18:58:28.528151+00:00 Received 200
I 2024-02-10 18:58:28.534368+00:00 requests.get https://social.lol/api/v1/statuses/111908520465897909/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:28.816302+00:00 Received 200
I 2024-02-10 18:58:28.819616+00:00 requests.get https://social.lol/api/v1/statuses/111908298507167617/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:29.030541+00:00 Received 200
I 2024-02-10 18:58:29.038707+00:00 requests.get https://social.lol/api/v1/statuses/111905259442974118/context {'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:29.349841+00:00 Received 200
I 2024-02-10 18:58:29.353131+00:00 requests.get https://social.lol/api/v1/statuses/111905259442974118/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:29.575046+00:00 Received 200
I 2024-02-10 18:58:29.635690+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:30.600184+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-10 18:58:30.603381+00:00 Received 200
I 2024-02-10 18:58:30.645690+00:00 Found 69 public activities: dict_keys(['tag:social.lol,2013:111908520465897909', 'tag:social.lol,2013:111908298507167617', 'tag:social.lol,2013:111908284591586698', 'tag:social.lol,2013:111905602057412666', 'tag:social.lol,2013:111905601619971263', 'tag:social.lol,2013:111905259442974118', 'tag:social.lol,2013:111905235261003850', 'tag:social.lol,2013:111905234294528231', 'tag:social.lol,2013:111904962220256671', 'tag:social.lol,2013:111904912870840402', 'tag:social.lol,2013:111904832417111828', 'tag:social.lol,2013:111904738380187540', 'tag:social.lol,2013:111904667202881634', 'tag:social.lol,2013:111904666479773960', 'tag:social.lol,2013:111904663807431679', 'tag:social.lol,2013:111904426027863948', 'tag:social.lol,2013:111904281411677034', 'tag:social.lol,2013:111904279483222122', 'tag:social.lol,2013:111904165807821565', 'tag:social.lol,2013:111903840548384633', 'tag:social.lol,2013:111903790744497331', 'tag:social.lol,2013:111903783629287137', 'tag:social.lol,2013:111903781883898271', 'tag:social.lol,2013:111903770401675163', 'tag:social.lol,2013:111903741405425205', 'tag:social.lol,2013:111903737170572576', 'tag:social.lol,2013:111903737085973585', 'tag:social.lol,2013:111903731306451600', 'tag:social.lol,2013:111903720754298672', 'tag:social.lol,2013:111903714259343807', 'tag:social.lol,2013:111908683567976667', 'tag:social.lol,2013:111908681171710521', 'tag:social.lol,2013:111905254220855886', 'tag:social.lol,2013:111904957535453644', 'tag:social.lol,2013:111904872676427711', 'tag:social.lol,2013:111904406167952395', 'tag:social.lol,2013:111903832799117986', 'tag:social.lol,2013:111903771744964997', 'tag:social.lol,2013:111903768462848813', 'tag:social.lol,2013:111903605801059050', 'tag:social.lol,2013:111903347916772916', 'tag:social.lol,2013:111903326405548791', 'tag:social.lol,2013:111903076487557934', 'tag:social.lol,2013:111902948190340809', 'tag:social.lol,2013:111902926031163458', 'tag:social.lol,2013:111902907292955382', 'tag:social.lol,2013:111902903880558960', 'tag:social.lol,2013:111902899770343664', 'tag:social.lol,2013:111902893611665630', 'tag:social.lol,2013:111902878900309767', 'tag:social.lol,2013:111902850125631760', 'tag:social.lol,2013:111902838346530406', 'tag:social.lol,2013:111902823782604890', 'tag:social.lol,2013:111902399110690127', 'tag:social.lol,2013:111901711216600812', 'tag:social.lol,2013:111901709463194255', 'tag:social.lol,2013:111900169089074591', 'tag:social.lol,2013:111899117979412737', 'tag:social.lol,2013:111899077484631591', 'tag:social.lol,2013:111898843791580989', 'tag:social.lol,2013:111898323393443064', 'tag:social.lol,2013:111898319282020010', 'tag:social.lol,2013:111898132590861426', 'tag:social.lol,2013:111897989227384615', 'tag:social.lol,2013:111897072273983615', 'tag:social.lol,2013:111896199586157148', 'tag:social.lol,2013:111896166031843438', 'tag:social.lol,2013:111895960529082594', 'tag:social.lol,2013:111893071483416912'])
I 2024-02-10 18:58:30.645919+00:00 Found 0 private activities: dict_keys([])
D 2024-02-10 18:58:30.653877+00:00 discovering original posts for: https://social.lol/@cory/111908520465897909
I 2024-02-10 18:58:30.654310+00:00 requests.head https://coryd.dev/blogroll.html {'headers': {}}
I 2024-02-10 18:58:31.034898+00:00 Received 200
I 2024-02-10 18:58:31.035487+00:00 requests.head https://coryd.dev/blogroll {'headers': {'User-Agent': '...'}}
I 2024-02-10 18:58:31.408556+00:00 Received 200
I 2024-02-10 18:58:31.408935+00:00 Original post discovery found original posts {'https://coryd.dev/blogroll.html', 'https://coryd.dev/blogroll'}, mentions {'https://hachyderm.io/@molly0xfff'}
I 2024-02-10 18:58:31.411276+00:00 requests.head https://social.lol/@cory/111908520465897909 {'headers': None}
I 2024-02-10 18:58:31.681808+00:00 Received 200
I 2024-02-10 18:58:31.682119+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111908520465897909
I 2024-02-10 18:58:31.738479+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-10 18:58:31.927044+00:00 Received 200
D 2024-02-10 18:58:31.928025+00:00 fetching author url https://coryd.dev/
I 2024-02-10 18:58:31.928226+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-10 18:58:32.168420+00:00 Received 200
D 2024-02-10 18:58:32.186431+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-10 18:58:32.187382+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.187579+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.187704+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.187810+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.187907+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.188016+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.188106+00:00 ignoring h-entry with no u-url!
D 2024-02-10 18:58:32.188204+00:00 ignoring h-entry with no u-url!
I 2024-02-10 18:58:32.188405+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-10 18:58:32.259059+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e90edf76010>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-10 18:58:32.259371+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-10 18:58:32.260416+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-10 18:58:32.260602+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-10 18:58:32.265418+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3e90ed54c810>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e90ed54c810>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2228, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1667, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e90ed54c810>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-10 18:58:32.267690+00:00 posse post discovery found no relationship for https://social.lol/@cory/111908520465897909
I 2024-02-10 18:58:32.431421+00:00 https://social.lol/@cory/111908520465897909 has 2 webmention target(s): https://coryd.dev/blogroll.html https://coryd.dev/blogroll
I 2024-02-10 18:58:32.431832+00:00 requests.get https://social.lol/api/v1/blocks?limit=100 {'headers': {'Authorization': '...'}}
I 2024-02-10 18:58:32.761374+00:00 Received 200
D 2024-02-10 18:58:32.845720+00:00 New webmentions to propagate! Response like tag:social.lol,2013:111908520465897909_favorited_by_111595898634370809 https://social.lol/@cory/111908520465897909#favorited-by-111595898634370809
I 2024-02-10 18:58:32.878974+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/07309884883914380371 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5clQLEghSZXNwb25zZSJGdGFnOnNvY2lhbC5sb2wsMjAxMzoxMTE5MDg1MjA0NjU4OTc5MDlfZmF2b3JpdGVkX2J5XzExMTU5NTg5ODYzNDM3MDgwOQw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-10 18:58:32.941050+00:00 discovering original posts for: https://social.lol/@cory/111908298507167617
I 2024-02-10 18:58:32.941552+00:00 Original post discovery found original posts {'https://coryd.dev/'}, mentions {'https://hachyderm.io/@molly0xfff'}
I 2024-02-10 18:58:32.942566+00:00 requests.head https://social.lol/@cory/111908298507167617 {'headers': None}
I 2024-02-10 18:58:33.130146+00:00 Received 200
I 2024-02-10 18:58:33.130656+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111908298507167617
I 2024-02-10 18:58:33.166700+00:00 https://social.lol/@cory/111908298507167617 has 1 webmention target(s): https://coryd.dev/
D 2024-02-10 18:58:33.222315+00:00 New webmentions to propagate! Response like tag:social.lol,2013:111908298507167617_favorited_by_111423842515442892 https://social.lol/@cory/111908298507167617#favorited-by-111423842515442892
I 2024-02-10 18:58:33.256555+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/79132763553832790471 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5clQLEghSZXNwb25zZSJGdGFnOnNvY2lhbC5sb2wsMjAxMzoxMTE5MDgyOTg1MDcxNjc2MTdfZmF2b3JpdGVkX2J5XzExMTQyMzg0MjUxNTQ0Mjg5Mgw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-10 18:58:33.328304+00:00 discovering original posts for: https://social.lol/@cory/111905259442974118
I 2024-02-10 18:58:33.328809+00:00 requests.head https://front-end.social/@a11yMel {'headers': {}}
I 2024-02-10 18:58:33.902084+00:00 Received 200
I 2024-02-10 18:58:33.902476+00:00 requests.head https://social.lol/@scottwillsey {'headers': {'User-Agent': '...'}}
I 2024-02-10 18:58:34.126391+00:00 Received 200
I 2024-02-10 18:58:34.126938+00:00 Original post discovery found original posts set(), mentions {'https://front-end.social/@a11yMel', 'https://social.lol/@scottwillsey'}
I 2024-02-10 18:58:34.127399+00:00 requests.head https://social.lol/@cory/111905259442974118 {'headers': None}
I 2024-02-10 18:58:34.390031+00:00 Received 200
I 2024-02-10 18:58:34.390315+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111905259442974118
D 2024-02-10 18:58:34.445744+00:00 skipping https://coryd.dev/, already fetched this round
D 2024-02-10 18:58:34.445956+00:00 skipping https://blog.coryd.dev/, already fetched this round
D 2024-02-10 18:58:34.446068+00:00 posse post discovery found no relationship for https://social.lol/@cory/111905259442974118
I 2024-02-10 18:58:34.791374+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-10 18:58:34.810328+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 10, 18, 49, 56, 826000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 10, 18, 58, 27, 28812, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-10 18:58:34.912686+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/78579204850420450851 with ETA 1707592996: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-10-18-58-27', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707592996
}