D 2024-02-23 09:17:59.006560+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-23-08-51-28')]
I 2024-02-23 09:17:59.032409+00:00 Source: @heydon@front-end.social (Mastodon) @heydon@front-end.social, https://brid.gy/mastodon/@heydon@front-end.social
I 2024-02-23 09:17:59.032893+00:00 Last poll: https://brid.gy/log?start_time=1708678288&key=agdicmlkLWd5ciYLEghNYXN0b2RvbiIYQGhleWRvbkBmcm9udC1lbmQuc29jaWFsDA
I 2024-02-23 09:17:59.065796+00:00 Updating @heydon@front-end.social (Mastodon) /mastodon/@heydon@front-end.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 23, 9, 17, 59, 33008, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-23 09:17:59.170889+00:00 no refresh_token
I 2024-02-23 09:17:59.186842+00:00 requests.get https://front-end.social/api/v1/accounts/109363923974146422/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:00.084043+00:00 Redirected to https://front-end.social/api/v1/accounts/109363923974146422/statuses?limit=30
I 2024-02-23 09:18:00.190318+00:00 Received 200
I 2024-02-23 09:18:00.195224+00:00 requests.get https://front-end.social/api/v1/statuses/111979964452213224/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:01.252263+00:00 Received 200
I 2024-02-23 09:18:01.255116+00:00 requests.get https://front-end.social/api/v1/statuses/111979917328923812/context {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:02.068290+00:00 Received 200
I 2024-02-23 09:18:02.072839+00:00 requests.get https://front-end.social/api/v1/statuses/111979917328923812/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:02.717471+00:00 Received 200
I 2024-02-23 09:18:02.752700+00:00 requests.get https://front-end.social/api/v1/statuses/111979917328923812/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:03.522743+00:00 Received 200
I 2024-02-23 09:18:03.528182+00:00 requests.get https://front-end.social/api/v1/statuses/111979694386036661/context {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:04.057477+00:00 Received 200
I 2024-02-23 09:18:04.059972+00:00 requests.get https://front-end.social/api/v1/statuses/111979694386036661/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:04.984430+00:00 Received 200
I 2024-02-23 09:18:05.058356+00:00 requests.get https://front-end.social/api/v1/statuses/111974147462812757/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:06.273095+00:00 Received 200
I 2024-02-23 09:18:06.370922+00:00 requests.get https://front-end.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:07.624928+00:00 Redirected to https://front-end.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-23 09:18:07.735557+00:00 Received 200
I 2024-02-23 09:18:07.850805+00:00 Found 63 public activities: dict_keys(['tag:front-end.social,2013:111979990509467551', 'tag:front-end.social,2013:111979964452213224', 'tag:front-end.social,2013:111979917328923812', 'tag:front-end.social,2013:111979875879476016', 'tag:front-end.social,2013:111979698501351052', 'tag:front-end.social,2013:111979694386036661', 'tag:front-end.social,2013:111978611132539188', 'tag:front-end.social,2013:111977090292583270', 'tag:front-end.social,2013:111977071816421404', 'tag:front-end.social,2013:111976901360451307', 'tag:front-end.social,2013:111974385626973341', 'tag:front-end.social,2013:111974147462812757', 'tag:front-end.social,2013:111973925798814919', 'tag:front-end.social,2013:111973737591059772', 'tag:front-end.social,2013:111973734061043011', 'tag:front-end.social,2013:111971835928265072', 'tag:front-end.social,2013:111971802382523405', 'tag:front-end.social,2013:111971783053025923', 'tag:front-end.social,2013:111971740514666384', 'tag:front-end.social,2013:111971720085539731', 'tag:front-end.social,2013:111971705953512185', 'tag:front-end.social,2013:111971698966043523', 'tag:front-end.social,2013:111971694065722962', 'tag:front-end.social,2013:111971676923050819', 'tag:front-end.social,2013:111971673035042856', 'tag:front-end.social,2013:111971662415528742', 'tag:front-end.social,2013:111971637845537109', 'tag:front-end.social,2013:111980042915843276', 'tag:front-end.social,2013:111979972680179789', 'tag:front-end.social,2013:111979926538480229', 'tag:front-end.social,2013:111979772747040156', 'tag:front-end.social,2013:111977733834410729', 'tag:front-end.social,2013:111977712897685392', 'tag:front-end.social,2013:111977697237991678', 'tag:front-end.social,2013:111977651865251863', 'tag:front-end.social,2013:111977576796876835', 'tag:front-end.social,2013:111977202463620343', 'tag:front-end.social,2013:111976801801426861', 'tag:front-end.social,2013:111976544306327608', 'tag:front-end.social,2013:111976543098456442', 'tag:front-end.social,2013:111976395162909440', 'tag:front-end.social,2013:111976021049809738', 'tag:front-end.social,2013:111974567682200226', 'tag:front-end.social,2013:111974449198788407', 'tag:front-end.social,2013:111974350570406144', 'tag:front-end.social,2013:111974344666462445', 'tag:front-end.social,2013:111974216061059265', 'tag:front-end.social,2013:111974195114199683', 'tag:front-end.social,2013:111974045926371838', 'tag:front-end.social,2013:111973999801397957', 'tag:front-end.social,2013:111973942434450637', 'tag:front-end.social,2013:111972752879051146', 'tag:front-end.social,2013:111972465939164782', 'tag:front-end.social,2013:111972210841792102', 'tag:front-end.social,2013:111972171683171940', 'tag:front-end.social,2013:111972167599181847', 'tag:front-end.social,2013:111972161993349797', 'tag:front-end.social,2013:111972130821100296', 'tag:front-end.social,2013:111972100239799418', 'tag:front-end.social,2013:111971758228710681', 'tag:front-end.social,2013:111971752236812189', 'tag:front-end.social,2013:111971725623113255', 'tag:front-end.social,2013:111971712549975151'])
I 2024-02-23 09:18:07.851042+00:00 Found 7 private activities: dict_keys(['tag:front-end.social,2013:111975787185641884', 'tag:front-end.social,2013:111974214957475239', 'tag:front-end.social,2013:111974095077002906', 'tag:front-end.social,2013:111975609783730336', 'tag:front-end.social,2013:111974225355122238', 'tag:front-end.social,2013:111974182438687179', 'tag:front-end.social,2013:111974072828721770'])
I 2024-02-23 09:18:07.859915+00:00 Skipping blocked/opt out user: {
"objectType": "person",
"id": "tag:fosstodon.org,2013:woodsbythesea",
"numeric_id": "109310357467570567",
"username": "woodsbythesea",
"displayName": "Woods By The Sea",
"url": "https://fosstodon.org/@woodsbythesea",
"urls": [
{
"value": "https://fosstodon.org/@woodsbythesea"
}
],
"image": {
"url": "https://cdn.masto.host/frontendsocial/cache/accounts/avatars/109/310/357/467/570/567/original/d9839cd3807337ac.jpg"
},
"published": "2022-11-04T00:00:00.000Z",
"description": "<p><a href=\"https://fosstodon.org/tags/nobot\" class=\"mention hashtag\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">#<span>nobot</span></a> <a href=\"https://fosstodon.org/tags/noarchive\" class=\"mention hashtag\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">#<span>noarchive</span></a></p>"
}
D 2024-02-23 09:18:07.957840+00:00 discovering original posts for: https://front-end.social/@heydon/111979964452213224
I 2024-02-23 09:18:07.958381+00:00 requests.head https://www.youtube.com/watch?v=gPlhat2pGns {'headers': {}}
I 2024-02-23 09:18:08.683420+00:00 Received 200
I 2024-02-23 09:18:08.683825+00:00 Original post discovery found original posts set(), mentions {'https://www.youtube.com/watch?v=gPlhat2pGns'}
I 2024-02-23 09:18:08.684223+00:00 requests.head https://front-end.social/@heydon/111979964452213224 {'headers': None}
I 2024-02-23 09:18:09.218789+00:00 Received 200
I 2024-02-23 09:18:09.219108+00:00 starting posse post discovery with syndicated https://front-end.social/@heydon/111979964452213224
I 2024-02-23 09:18:09.251117+00:00 requests.head https://mutable.gallery/ {'headers': {}}
I 2024-02-23 09:18:09.582907+00:00 Received 200
D 2024-02-23 09:18:09.583954+00:00 fetching author url https://mutable.gallery/
I 2024-02-23 09:18:09.584100+00:00 requests.get https://mutable.gallery/ {'gateway': False, 'headers': {}}
I 2024-02-23 09:18:09.764757+00:00 Received 200
D 2024-02-23 09:18:09.773921+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-23 09:18:09.774436+00:00 requests.head https://every-layout.dev/ {'headers': {}}
I 2024-02-23 09:18:10.022051+00:00 Received 200
D 2024-02-23 09:18:10.023044+00:00 fetching author url https://every-layout.dev/
I 2024-02-23 09:18:10.023179+00:00 requests.get https://every-layout.dev/ {'gateway': False, 'headers': {}}
I 2024-02-23 09:18:10.258688+00:00 Received 200
D 2024-02-23 09:18:10.335605+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-23 09:18:10.336496+00:00 requests.head https://briefs.video/ {'headers': {}}
I 2024-02-23 09:18:10.543089+00:00 Received 200
D 2024-02-23 09:18:10.544157+00:00 fetching author url https://briefs.video/
I 2024-02-23 09:18:10.544290+00:00 requests.get https://briefs.video/ {'gateway': False, 'headers': {}}
I 2024-02-23 09:18:10.763083+00:00 Received 200
D 2024-02-23 09:18:10.775177+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-23 09:18:10.775753+00:00 requests.head https://webbed-briefs.teemill.com/collection/new {'headers': {}}
W 2024-02-23 09:18:25.791220+00:00 Couldn't resolve URL https://webbed-briefs.teemill.com/collection/new : HTTPSConnectionPool(host='webbed-briefs.teemill.com', port=443): Max retries exceeded with url: /collection/new (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e9896b39350>, 'Connection to webbed-briefs.teemill.com timed out. (connect timeout=15)'))
W 2024-02-23 09:18:25.791553+00:00 Couldn't resolve URL https://webbed-briefs.teemill.com/collection/new: https://webbed-briefs.teemill.com/collection/new
D 2024-02-23 09:18:25.793247+00:00 fetching author url https://webbed-briefs.teemill.com/collection/new
I 2024-02-23 09:18:25.793412+00:00 requests.get https://webbed-briefs.teemill.com/collection/new {'gateway': False, 'headers': {}}
I 2024-02-23 09:18:40.797436+00:00 Could not fetch author url https://webbed-briefs.teemill.com/collection/new
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: timed out
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x3e9896b3ac50>, 'Connection to webbed-briefs.teemill.com timed out. (connect timeout=15)')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='webbed-briefs.teemill.com', port=443): Max retries exceeded with url: /collection/new (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e9896b3ac50>, 'Connection to webbed-briefs.teemill.com timed out. (connect timeout=15)'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2234, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1673, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 507, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='webbed-briefs.teemill.com', port=443): Max retries exceeded with url: /collection/new (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e9896b3ac50>, 'Connection to webbed-briefs.teemill.com timed out. (connect timeout=15)'))
D 2024-02-23 09:18:40.800134+00:00 posse post discovery found no relationship for https://front-end.social/@heydon/111979964452213224
D 2024-02-23 09:18:41.081328+00:00 discovering original posts for: https://front-end.social/@heydon/111979917328923812
I 2024-02-23 09:18:41.081798+00:00 requests.head https://heydonworks.com/article/what-is-utility-first-css/ {'headers': {}}
I 2024-02-23 09:18:41.333775+00:00 Received 200
I 2024-02-23 09:18:41.334112+00:00 Original post discovery found original posts set(), mentions {'https://heydonworks.com/article/what-is-utility-first-css/'}
I 2024-02-23 09:18:41.335166+00:00 requests.head https://front-end.social/@heydon/111979917328923812 {'headers': None}
I 2024-02-23 09:18:41.931080+00:00 Received 200
I 2024-02-23 09:18:41.931378+00:00 starting posse post discovery with syndicated https://front-end.social/@heydon/111979917328923812
I 2024-02-23 09:18:41.969387+00:00 https://front-end.social/@heydon/111979917328923812 has 1 webmention target(s): https://heydonworks.com/article/what-is-utility-first-css/
I 2024-02-23 09:18:41.969663+00:00 requests.get https://front-end.social/api/v1/blocks?limit=100 {'headers': {'Authorization': '...'}}
I 2024-02-23 09:18:42.806899+00:00 Received 200
D 2024-02-23 09:18:42.888321+00:00 New webmentions to propagate! Response comment tag:front-end.social,2013:111979990509467551 https://front-end.social/@heydon/111979990509467551
I 2024-02-23 09:18:42.925257+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/6001264217274391472 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cjoLEghSZXNwb25zZSIsdGFnOmZyb250LWVuZC5zb2NpYWwsMjAxMzoxMTE5Nzk5OTA1MDk0Njc1NTEM', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-02-23 09:18:42.980397+00:00 https://front-end.social/@heydon/111979917328923812 has 1 webmention target(s): https://heydonworks.com/article/what-is-utility-first-css/
D 2024-02-23 09:18:43.019264+00:00 New webmentions to propagate! Response comment tag:front-end.social,2013:111980042915843276 https://mastodon.social/@nrk9819/111980042840893476
I 2024-02-23 09:18:43.054941+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/6996322216529914606 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cjoLEghSZXNwb25zZSIsdGFnOmZyb250LWVuZC5zb2NpYWwsMjAxMzoxMTE5ODAwNDI5MTU4NDMyNzYM', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-23 09:18:44.333725+00:00 discovering original posts for: https://front-end.social/@heydon/111979694386036661
I 2024-02-23 09:18:44.334289+00:00 requests.head https://front-end.social/tags/AxeCon {'headers': {}}
I 2024-02-23 09:18:45.122933+00:00 Received 200
I 2024-02-23 09:18:45.123286+00:00 requests.head https://front-end.social/tags/oldDeveloper {'headers': {'User-Agent': '...'}}
I 2024-02-23 09:18:45.736113+00:00 Received 200
I 2024-02-23 09:18:45.736403+00:00 requests.head https://front-end.social/tags/middleAged {'headers': {'User-Agent': '...'}}
I 2024-02-23 09:18:46.519199+00:00 Received 200
I 2024-02-23 09:18:46.519674+00:00 requests.head https://front-end.social/tags/soTired {'headers': {'User-Agent': '...'}}
I 2024-02-23 09:18:47.104455+00:00 Received 200
I 2024-02-23 09:18:47.104726+00:00 requests.head https://front-end.social/tags/virtuallyObsolete {'headers': {'User-Agent': '...'}}
I 2024-02-23 09:18:48.016031+00:00 Received 200
I 2024-02-23 09:18:48.016442+00:00 Original post discovery found original posts set(), mentions {'https://front-end.social/tags/AxeCon', 'https://front-end.social/tags/oldDeveloper', 'https://front-end.social/tags/soTired', 'https://front-end.social/tags/virtuallyObsolete', 'https://front-end.social/tags/middleAged'}
I 2024-02-23 09:18:48.020046+00:00 requests.head https://front-end.social/@heydon/111979694386036661 {'headers': None}
I 2024-02-23 09:18:48.561849+00:00 Received 200
I 2024-02-23 09:18:48.562095+00:00 starting posse post discovery with syndicated https://front-end.social/@heydon/111979694386036661
D 2024-02-23 09:18:49.062281+00:00 discovering original posts for: https://front-end.social/@heydon/111974147462812757
I 2024-02-23 09:18:49.062607+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-23 09:18:49.062897+00:00 requests.head https://front-end.social/@heydon/111974147462812757 {'headers': None}
I 2024-02-23 09:18:50.153135+00:00 Received 200
I 2024-02-23 09:18:50.153396+00:00 starting posse post discovery with syndicated https://front-end.social/@heydon/111974147462812757
I 2024-02-23 09:18:54.815335+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-07-13 12:33:14.904313+00:00
I 2024-02-23 09:18:54.865567+00:00 Updating @heydon@front-end.social (Mastodon) /mastodon/@heydon@front-end.social : {'last_public_post': datetime.datetime(2024, 2, 23, 9, 17, 32), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 23, 9, 17, 59, 33008, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-23 09:18:55.050124+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/53345158061161024371 with ETA 1708681902: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ciYLEghNYXN0b2RvbiIYQGhleWRvbkBmcm9udC1lbmQuc29jaWFsDA&last_polled=2024-02-23-09-17-59', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708681902
}