D 2024-02-23 07:45:35.007863+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-23-07-09-57')]
I 2024-02-23 07:45:35.273163+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-23 07:45:35.273566+00:00 Last poll: https://brid.gy/log?start_time=1708672197&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-23 07:45:35.303991+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 23, 7, 45, 35, 273672, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-23 07:45:35.465892+00:00 no refresh_token
I 2024-02-23 07:45:35.548444+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-23 07:45:36.351084+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-23 07:45:36.353721+00:00 Received 200
I 2024-02-23 07:45:36.360693+00:00 requests.get https://social.lol/api/v1/statuses/111978307039226575/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-23 07:45:36.646695+00:00 Received 200
I 2024-02-23 07:45:36.752843+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-23 07:45:38.503687+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-23 07:45:38.506432+00:00 Received 200
I 2024-02-23 07:45:38.565943+00:00 Found 62 public activities: dict_keys(['tag:social.lol,2013:111978498061666793', 'tag:social.lol,2013:111978326805527176', 'tag:social.lol,2013:111978307039226575', 'tag:social.lol,2013:111978172671571122', 'tag:social.lol,2013:111977891634117296', 'tag:social.lol,2013:111977842109610061', 'tag:social.lol,2013:111977689472744753', 'tag:social.lol,2013:111977634664818957', 'tag:social.lol,2013:111977419128926859', 'tag:social.lol,2013:111977416003230483', 'tag:social.lol,2013:111977320979048544', 'tag:social.lol,2013:111977307834041673', 'tag:social.lol,2013:111977304917670313', 'tag:social.lol,2013:111977286706862566', 'tag:social.lol,2013:111977272832761727', 'tag:social.lol,2013:111977243935596287', 'tag:social.lol,2013:111977242343325675', 'tag:social.lol,2013:111977219713329370', 'tag:social.lol,2013:111977215347130158', 'tag:social.lol,2013:111977211594964190', 'tag:social.lol,2013:111977210019203546', 'tag:social.lol,2013:111977205900197593', 'tag:social.lol,2013:111977192312482254', 'tag:social.lol,2013:111977167165232216', 'tag:social.lol,2013:111977162590977841', 'tag:social.lol,2013:111977156653928739', 'tag:social.lol,2013:111977088237311694', 'tag:social.lol,2013:111976918720965747', 'tag:social.lol,2013:111978617548029617', 'tag:social.lol,2013:111978320200917966', 'tag:social.lol,2013:111977910627597215', 'tag:social.lol,2013:111977836233426825', 'tag:social.lol,2013:111977417151526976', 'tag:social.lol,2013:111977318071474810', 'tag:social.lol,2013:111977297829717989', 'tag:social.lol,2013:111977284087005662', 'tag:social.lol,2013:111977231641554651', 'tag:social.lol,2013:111977216263090706', 'tag:social.lol,2013:111977209877155094', 'tag:social.lol,2013:111977205439108322', 'tag:social.lol,2013:111977189485319090', 'tag:social.lol,2013:111977019206175994', 'tag:social.lol,2013:111976909185377279', 'tag:social.lol,2013:111976874995026903', 'tag:social.lol,2013:111976822107406461', 'tag:social.lol,2013:111976745321009146', 'tag:social.lol,2013:111976588250425013', 'tag:social.lol,2013:111976538895621048', 'tag:social.lol,2013:111976499907082237', 'tag:social.lol,2013:111974108196207120', 'tag:social.lol,2013:111972842481126183', 'tag:social.lol,2013:111972495832285608', 'tag:social.lol,2013:111972400594353648', 'tag:social.lol,2013:111972349097822836', 'tag:social.lol,2013:111971416220533888', 'tag:social.lol,2013:111971389408219780', 'tag:social.lol,2013:111970872519476485', 'tag:social.lol,2013:111970698081225092', 'tag:social.lol,2013:111970678014120642', 'tag:social.lol,2013:111966739068597957', 'tag:social.lol,2013:111966614423608083', 'tag:social.lol,2013:111966591876103913'])
I 2024-02-23 07:45:38.566195+00:00 Found 5 private activities: dict_keys(['tag:social.lol,2013:111978257590129117', 'tag:social.lol,2013:111978195690912719', 'tag:social.lol,2013:111978253067475924', 'tag:social.lol,2013:111966351570451416', 'tag:social.lol,2013:111966335224128143'])
D 2024-02-23 07:45:38.568731+00:00 discovering original posts for: https://social.lol/@cory/111978307039226575
I 2024-02-23 07:45:38.568916+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-23 07:45:38.569176+00:00 requests.head https://social.lol/@cory/111978307039226575 {'headers': None}
I 2024-02-23 07:45:38.858886+00:00 Received 200
I 2024-02-23 07:45:38.859214+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111978307039226575
I 2024-02-23 07:45:38.893583+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-23 07:45:39.250884+00:00 Received 200
D 2024-02-23 07:45:39.252311+00:00 fetching author url https://coryd.dev/
I 2024-02-23 07:45:39.252987+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-23 07:45:39.558842+00:00 Received 200
D 2024-02-23 07:45:39.570712+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-23 07:45:39.571226+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571377+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571484+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571605+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571699+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571796+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571885+00:00 ignoring h-entry with no u-url!
D 2024-02-23 07:45:39.571980+00:00 ignoring h-entry with no u-url!
I 2024-02-23 07:45:39.572170+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-23 07:45:39.599317+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3eb1404bed90>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-23 07:45:39.599594+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-23 07:45:39.600834+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-23 07:45:39.600988+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-23 07:45:39.606548+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3eb1404bfb90>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3eb1404bfb90>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2234, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1673, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3eb1404bfb90>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-23 07:45:39.610243+00:00 posse post discovery found no relationship for https://social.lol/@cory/111978307039226575
I 2024-02-23 07:45:39.880975+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-23 07:45:39.898366+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 23, 3, 15, 4), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 23, 7, 45, 35, 273672, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-23 07:45:39.993992+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/0881176621818523328 with ETA 1708675970: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-23-07-45-35', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708675970
}