D 2024-02-02 01:41:04.008084+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-01-21-12-21')]
I 2024-02-02 01:41:04.052660+00:00 Source: @jamesravey@fosstodon.org (Mastodon) @jamesravey@fosstodon.org, https://brid.gy/mastodon/@jamesravey@fosstodon.org
I 2024-02-02 01:41:04.053140+00:00 Last poll: https://brid.gy/log?start_time=1706821941&key=agdicmlkLWd5cicLEghNYXN0b2RvbiIZQGphbWVzcmF2ZXlAZm9zc3RvZG9uLm9yZww
I 2024-02-02 01:41:04.092347+00:00 Updating @jamesravey@fosstodon.org (Mastodon) /mastodon/@jamesravey@fosstodon.org : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 2, 1, 41, 4, 53265, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-02 01:41:04.222793+00:00 no refresh_token
I 2024-02-02 01:41:04.266045+00:00 requests.get https://fosstodon.org/api/v1/accounts/117012/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-02 01:41:05.263627+00:00 Redirected to https://fosstodon.org/api/v1/accounts/117012/statuses?limit=30
I 2024-02-02 01:41:05.298910+00:00 Received 200
I 2024-02-02 01:41:05.397217+00:00 requests.get https://fosstodon.org/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-02 01:41:06.411497+00:00 Redirected to https://fosstodon.org/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-02 01:41:06.477485+00:00 Received 200
I 2024-02-02 01:41:06.525944+00:00 Found 37 public activities: dict_keys(['tag:fosstodon.org,2013:111857607529119780', 'tag:fosstodon.org,2013:111852706628085152', 'tag:fosstodon.org,2013:111851004754972561', 'tag:fosstodon.org,2013:111850691789409162', 'tag:fosstodon.org,2013:111850688364056368', 'tag:fosstodon.org,2013:111850200889238270', 'tag:fosstodon.org,2013:111849691741397730', 'tag:fosstodon.org,2013:111849564400528830', 'tag:fosstodon.org,2013:111832537888291184', 'tag:fosstodon.org,2013:111832536070044314', 'tag:fosstodon.org,2013:111832441168458338', 'tag:fosstodon.org,2013:111828928362506329', 'tag:fosstodon.org,2013:111828598552107179', 'tag:fosstodon.org,2013:111828585647069901', 'tag:fosstodon.org,2013:111817767828902479', 'tag:fosstodon.org,2013:111817761432681482', 'tag:fosstodon.org,2013:111815917270493638', 'tag:fosstodon.org,2013:111811868604978389', 'tag:fosstodon.org,2013:111811850108333396', 'tag:fosstodon.org,2013:111811710142862427', 'tag:fosstodon.org,2013:111810598171275370', 'tag:fosstodon.org,2013:111809934729326204', 'tag:fosstodon.org,2013:111806749563910670', 'tag:fosstodon.org,2013:111806671827143154', 'tag:fosstodon.org,2013:111806565920844784', 'tag:fosstodon.org,2013:111806036573619840', 'tag:fosstodon.org,2013:111805241757612909', 'tag:fosstodon.org,2013:111805047997650969', 'tag:fosstodon.org,2013:111805042190904481', 'tag:fosstodon.org,2013:111804283507120918', 'tag:fosstodon.org,2013:111855841047355495', 'tag:fosstodon.org,2013:111829107489350255', 'tag:fosstodon.org,2013:111806608840805836', 'tag:fosstodon.org,2013:111736289432623386', 'tag:fosstodon.org,2013:111725439293748489', 'tag:fosstodon.org,2013:111705197746089279', 'tag:fosstodon.org,2013:111705190915536224'])
I 2024-02-02 01:41:06.526318+00:00 Found 2 private activities: dict_keys(['tag:fosstodon.org,2013:111801462830138643', 'tag:fosstodon.org,2013:111747372631070392'])
I 2024-02-02 01:41:06.528232+00:00 refetching h-feed for source @jamesravey@fosstodon.org (Mastodon)
D 2024-02-02 01:41:06.528447+00:00 attempting to refetch h-feed for @jamesravey@fosstodon.org (Mastodon)
I 2024-02-02 01:41:06.528703+00:00 requests.head https://brainsteam.co.uk/ {'headers': {}}
W 2024-02-02 01:41:21.917580+00:00 Couldn't resolve URL https://brainsteam.co.uk/ : HTTPSConnectionPool(host='brainsteam.co.uk', port=443): Read timed out. (read timeout=15)
W 2024-02-02 01:41:21.917891+00:00 Couldn't resolve URL https://brainsteam.co.uk/: https://brainsteam.co.uk/
D 2024-02-02 01:41:21.918995+00:00 fetching author url https://brainsteam.co.uk/
I 2024-02-02 01:41:21.992975+00:00 requests.get https://brainsteam.co.uk/ {'gateway': False, 'headers': {}}
I 2024-02-02 01:41:37.416665+00:00 Could not fetch author url https://brainsteam.co.uk/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 536, in _make_request
response = conn.getresponse()
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 1386, in getresponse
response.begin()
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 325, in begin
version, status, reason = self._read_status()
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 286, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 706, in readinto
return self._sock.recv_into(b)
^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/ssl.py", line 1315, in recv_into
return self.read(nbytes, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/ssl.py", line 1167, in read
return self._sslobj.read(len, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TimeoutError: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 844, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 470, in increment
raise reraise(type(error), error, _stacktrace)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/util.py", line 39, in reraise
raise value
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 790, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 538, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 370, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='brainsteam.co.uk', port=443): Read timed out. (read timeout=15)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 532, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='brainsteam.co.uk', port=443): Read timed out. (read timeout=15)
I 2024-02-02 01:41:37.507022+00:00 requests.head https://jamesravey.me/ {'headers': {}}
W 2024-02-02 01:41:53.327653+00:00 Couldn't resolve URL https://jamesravey.me/ : HTTPSConnectionPool(host='jamesravey.me', port=443): Read timed out. (read timeout=15)
W 2024-02-02 01:41:53.328007+00:00 Couldn't resolve URL https://jamesravey.me/: https://jamesravey.me/
D 2024-02-02 01:41:53.329092+00:00 fetching author url https://jamesravey.me/
I 2024-02-02 01:41:53.329246+00:00 requests.get https://jamesravey.me/ {'gateway': False, 'headers': {}}
I 2024-02-02 01:42:08.492463+00:00 Could not fetch author url https://jamesravey.me/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 536, in _make_request
response = conn.getresponse()
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 1386, in getresponse
response.begin()
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 325, in begin
version, status, reason = self._read_status()
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/http/client.py", line 286, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 706, in readinto
return self._sock.recv_into(b)
^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/ssl.py", line 1315, in recv_into
return self.read(nbytes, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/ssl.py", line 1167, in read
return self._sslobj.read(len, buffer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TimeoutError: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 844, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 470, in increment
raise reraise(type(error), error, _stacktrace)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/util.py", line 39, in reraise
raise value
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 790, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 538, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 370, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='jamesravey.me', port=443): Read timed out. (read timeout=15)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 532, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='jamesravey.me', port=443): Read timed out. (read timeout=15)
I 2024-02-02 01:42:08.549997+00:00 Updating @jamesravey@fosstodon.org (Mastodon) /mastodon/@jamesravey@fosstodon.org : {'last_public_post': datetime.datetime(2024, 2, 1, 15, 43, 28), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 2, 1, 41, 4, 53265, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_hfeed_refetch': datetime.datetime(2024, 2, 2, 1, 42, 8, 510355, tzinfo=datetime.timezone.utc)}
I 2024-02-02 01:42:08.627718+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/6382855515677578505 with ETA 1706855278: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5cicLEghNYXN0b2RvbiIZQGphbWVzcmF2ZXlAZm9zc3RvZG9uLm9yZww&last_polled=2024-02-02-01-41-04', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1706855278
}