D 2024-02-05 17:05:09.008564+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-05-16-30-10')]
I 2024-02-05 17:05:09.032126+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-05 17:05:09.032718+00:00 Last poll: https://brid.gy/log?start_time=1707150610&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-05 17:05:09.057181+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 5, 17, 5, 9, 32874, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-05 17:05:09.186354+00:00 no refresh_token
I 2024-02-05 17:05:09.202556+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-05 17:05:09.927310+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-05 17:05:09.931176+00:00 Received 200
I 2024-02-05 17:05:09.937437+00:00 requests.get https://social.lol/api/v1/statuses/111879865853424160/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-05 17:05:10.122894+00:00 Received 200
I 2024-02-05 17:05:10.126946+00:00 requests.get https://social.lol/api/v1/statuses/111879830151366623/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-05 17:05:10.294717+00:00 Received 200
I 2024-02-05 17:05:10.382566+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-05 17:05:12.279582+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-05 17:05:12.324196+00:00 Received 200
I 2024-02-05 17:05:12.480148+00:00 Found 68 public activities: dict_keys(['tag:social.lol,2013:111879865853424160', 'tag:social.lol,2013:111879830151366623', 'tag:social.lol,2013:111879727065565215', 'tag:social.lol,2013:111879559934190152', 'tag:social.lol,2013:111879273197396660', 'tag:social.lol,2013:111877358131331599', 'tag:social.lol,2013:111876885559852653', 'tag:social.lol,2013:111876591324858442', 'tag:social.lol,2013:111876454898797971', 'tag:social.lol,2013:111876338939046817', 'tag:social.lol,2013:111876108799769016', 'tag:social.lol,2013:111876032983794125', 'tag:social.lol,2013:111875973737937008', 'tag:social.lol,2013:111875844167193437', 'tag:social.lol,2013:111875815364023129', 'tag:social.lol,2013:111875468324209711', 'tag:social.lol,2013:111875305008532348', 'tag:social.lol,2013:111875292129881291', 'tag:social.lol,2013:111875266394382225', 'tag:social.lol,2013:111875185798240065', 'tag:social.lol,2013:111874622987387568', 'tag:social.lol,2013:111874581672407112', 'tag:social.lol,2013:111874581276523850', 'tag:social.lol,2013:111874579937788207', 'tag:social.lol,2013:111874525880128081', 'tag:social.lol,2013:111874423602326234', 'tag:social.lol,2013:111874410161325230', 'tag:social.lol,2013:111874232138305136', 'tag:social.lol,2013:111874038681543723', 'tag:social.lol,2013:111874037090269187', 'tag:social.lol,2013:111879677536610795', 'tag:social.lol,2013:111879675935245733', 'tag:social.lol,2013:111879671630300825', 'tag:social.lol,2013:111879544484774045', 'tag:social.lol,2013:111879256301152496', 'tag:social.lol,2013:111877413412527224', 'tag:social.lol,2013:111877300500689223', 'tag:social.lol,2013:111877272716868460', 'tag:social.lol,2013:111876105287032498', 'tag:social.lol,2013:111876019103569574', 'tag:social.lol,2013:111875917218225657', 'tag:social.lol,2013:111875869590030083', 'tag:social.lol,2013:111875490518086461', 'tag:social.lol,2013:111874621132327209', 'tag:social.lol,2013:111874574261013400', 'tag:social.lol,2013:111874416291213856', 'tag:social.lol,2013:111870632783800219', 'tag:social.lol,2013:111870568339201176', 'tag:social.lol,2013:111870545351032488', 'tag:social.lol,2013:111870512935839380', 'tag:social.lol,2013:111870509987905485', 'tag:social.lol,2013:111870472367910714', 'tag:social.lol,2013:111870455786663468', 'tag:social.lol,2013:111870412033497511', 'tag:social.lol,2013:111870161696396188', 'tag:social.lol,2013:111870127303631543', 'tag:social.lol,2013:111870114426388423', 'tag:social.lol,2013:111870056244582260', 'tag:social.lol,2013:111870048942583729', 'tag:social.lol,2013:111870030146759538', 'tag:social.lol,2013:111869869543527792', 'tag:social.lol,2013:111869544832782431', 'tag:social.lol,2013:111869527656369574', 'tag:social.lol,2013:111866545579243246', 'tag:social.lol,2013:111866468331550273', 'tag:social.lol,2013:111866225648013110', 'tag:social.lol,2013:111864629470699094', 'tag:social.lol,2013:111864481785181611'])
I 2024-02-05 17:05:12.481182+00:00 Found 0 private activities: dict_keys([])
D 2024-02-05 17:05:12.489362+00:00 discovering original posts for: https://social.lol/@cory/111879865853424160
I 2024-02-05 17:05:12.489648+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-05 17:05:12.489979+00:00 requests.head https://social.lol/@cory/111879865853424160 {'headers': None}
I 2024-02-05 17:05:12.785621+00:00 Received 200
I 2024-02-05 17:05:12.786056+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111879865853424160
I 2024-02-05 17:05:12.825017+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-05 17:05:13.111709+00:00 Received 200
D 2024-02-05 17:05:13.113448+00:00 fetching author url https://coryd.dev/
I 2024-02-05 17:05:13.113625+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-05 17:05:13.358297+00:00 Received 200
D 2024-02-05 17:05:13.384323+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-05 17:05:13.386447+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.387333+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.388027+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.388702+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.389187+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.389415+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.390194+00:00 ignoring h-entry with no u-url!
D 2024-02-05 17:05:13.390427+00:00 ignoring h-entry with no u-url!
I 2024-02-05 17:05:13.391236+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-05 17:05:13.457676+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3ef78df2ca90>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-05 17:05:13.457997+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-05 17:05:13.472449+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-05 17:05:13.472702+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-05 17:05:13.479428+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3ef78df0b210>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3ef78df0b210>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3ef78df0b210>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-05 17:05:13.485329+00:00 posse post discovery found no relationship for https://social.lol/@cory/111879865853424160
D 2024-02-05 17:05:14.032325+00:00 discovering original posts for: https://social.lol/@cory/111879830151366623
I 2024-02-05 17:05:14.032903+00:00 requests.head https://hachyderm.io/@wbrowar {'headers': {}}
I 2024-02-05 17:05:14.553134+00:00 Received 200
I 2024-02-05 17:05:14.553590+00:00 requests.head https://mastodon.social/@cferdinandi {'headers': {'User-Agent': '...'}}
I 2024-02-05 17:05:15.106117+00:00 Received 200
I 2024-02-05 17:05:15.106700+00:00 Original post discovery found original posts set(), mentions {'https://mastodon.social/@cferdinandi', 'https://hachyderm.io/@wbrowar'}
I 2024-02-05 17:05:15.107572+00:00 requests.head https://social.lol/@cory/111879830151366623 {'headers': None}
I 2024-02-05 17:05:15.471811+00:00 Received 200
I 2024-02-05 17:05:15.472161+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111879830151366623
D 2024-02-05 17:05:15.570808+00:00 skipping https://coryd.dev/, already fetched this round
D 2024-02-05 17:05:15.571112+00:00 skipping https://blog.coryd.dev/, already fetched this round
D 2024-02-05 17:05:15.571212+00:00 posse post discovery found no relationship for https://social.lol/@cory/111879830151366623
I 2024-02-05 17:05:15.915989+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-05 17:05:15.936882+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 5, 16, 41, 13, 399000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 5, 17, 5, 9, 32874, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-05 17:05:16.093557+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/20083786466305621041 with ETA 1707154819: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-05-17-05-09', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707154819
}