D 2024-02-14 12:51:02.016322+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-13-09-07-41')]
I 2024-02-14 12:51:02.061552+00:00 Source: @TheRMan@vt.social (Mastodon) @therman@vt.social, https://brid.gy/mastodon/@therman@vt.social
I 2024-02-14 12:51:02.062193+00:00 Last poll: https://brid.gy/log?start_time=1707815261&key=agdicmlkLWd5ciALEghNYXN0b2RvbiISQHRoZXJtYW5AdnQuc29jaWFsDA
I 2024-02-14 12:51:02.099463+00:00 Updating @TheRMan@vt.social (Mastodon) /mastodon/@therman@vt.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 14, 12, 51, 2, 62363, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-14 12:51:02.226899+00:00 no refresh_token
I 2024-02-14 12:51:02.258807+00:00 requests.get https://vt.social/api/v1/accounts/109366050795398980/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-14 12:51:05.018998+00:00 Redirected to https://vt.social/api/v1/accounts/109366050795398980/statuses?limit=30
I 2024-02-14 12:51:05.024876+00:00 Received 200
I 2024-02-14 12:51:05.053517+00:00 requests.get https://vt.social/api/v1/statuses/111925224776249005/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-14 12:51:05.739622+00:00 Received 200
I 2024-02-14 12:51:05.863982+00:00 requests.get https://vt.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-14 12:51:11.019392+00:00 Redirected to https://vt.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-14 12:51:11.024249+00:00 Received 200
I 2024-02-14 12:51:11.077957+00:00 Found 49 public activities: dict_keys(['tag:vt.social,2013:111929489577409592', 'tag:vt.social,2013:111929485367217610', 'tag:vt.social,2013:111925224776249005', 'tag:vt.social,2013:111912591904562057', 'tag:vt.social,2013:111912012867526895', 'tag:vt.social,2013:111908054005540157', 'tag:vt.social,2013:111907268423267381', 'tag:vt.social,2013:111906835758742095', 'tag:vt.social,2013:111899702541366845', 'tag:vt.social,2013:111897489249914522', 'tag:vt.social,2013:111896568425232642', 'tag:vt.social,2013:111891368328767346', 'tag:vt.social,2013:111890662518778611', 'tag:vt.social,2013:111889853468492785', 'tag:vt.social,2013:111887359206966154', 'tag:vt.social,2013:111885165218104264', 'tag:vt.social,2013:111884186535138689', 'tag:vt.social,2013:111870527959647059', 'tag:vt.social,2013:111868819442945415', 'tag:vt.social,2013:111867199926331578', 'tag:vt.social,2013:111866948498201787', 'tag:vt.social,2013:111866773820884305', 'tag:vt.social,2013:111863681910146353', 'tag:vt.social,2013:111862901585062297', 'tag:vt.social,2013:111861537275944163', 'tag:vt.social,2013:111858253283010425', 'tag:vt.social,2013:111857255742649490', 'tag:vt.social,2013:111855874979225821', 'tag:vt.social,2013:111855636903948633', 'tag:vt.social,2013:111855407921983452', 'tag:vt.social,2013:111814325923492219', 'tag:vt.social,2013:111737461799973987', 'tag:vt.social,2013:111708142444406944', 'tag:vt.social,2013:111699214539523767', 'tag:vt.social,2013:111679802762744219', 'tag:vt.social,2013:111662804857751110', 'tag:vt.social,2013:111640234537422185', 'tag:vt.social,2013:111544724916804624', 'tag:vt.social,2013:111529103275061955', 'tag:vt.social,2013:111529098590469295', 'tag:vt.social,2013:111439398866564367', 'tag:vt.social,2013:111394267241907078', 'tag:vt.social,2013:111381986231845778', 'tag:vt.social,2013:111377704821730803', 'tag:vt.social,2013:111376391133579415', 'tag:vt.social,2013:111372890201593514', 'tag:vt.social,2013:111308202484104338', 'tag:vt.social,2013:111277295031419373', 'tag:vt.social,2013:111277217699277656'])
I 2024-02-14 12:51:11.078262+00:00 Found 1 private activities: dict_keys(['tag:vt.social,2013:111477070823019571'])
D 2024-02-14 12:51:11.086450+00:00 discovering original posts for: https://vt.social/@TheRMan/111925224776249005
I 2024-02-14 12:51:11.087186+00:00 requests.head https://vt.social/tags/Dokibird {'headers': {}}
I 2024-02-14 12:51:11.893245+00:00 Received 200
I 2024-02-14 12:51:11.893661+00:00 requests.head https://vt.social/tags/Dragoons {'headers': {'User-Agent': '...'}}
I 2024-02-14 12:51:12.638832+00:00 Received 200
I 2024-02-14 12:51:12.639231+00:00 requests.head https://vt.social/tags/500kBeforeTheEndOfTheYear {'headers': {'User-Agent': '...'}}
I 2024-02-14 12:51:13.247798+00:00 Received 200
I 2024-02-14 12:51:13.248206+00:00 Original post discovery found original posts set(), mentions {'https://vt.social/tags/Dokibird', 'https://vt.social/tags/500kBeforeTheEndOfTheYear', 'https://vt.social/tags/Dragoons'}
I 2024-02-14 12:51:13.251157+00:00 requests.head https://vt.social/@TheRMan/111925224776249005 {'headers': None}
I 2024-02-14 12:51:13.911302+00:00 Received 200
I 2024-02-14 12:51:13.911624+00:00 starting posse post discovery with syndicated https://vt.social/@TheRMan/111925224776249005
I 2024-02-14 12:51:14.032643+00:00 requests.head https://www.tiktok.com/@therman98 {'headers': {}}
I 2024-02-14 12:51:14.323202+00:00 Received 403
W 2024-02-14 12:51:14.323659+00:00 Couldn't resolve URL https://www.tiktok.com/@therman98: https://www.tiktok.com/@therman98
I 2024-02-14 12:51:14.323999+00:00 requests.head https://www.fiverr.com/s/p6LNxR {'headers': {}}
I 2024-02-14 12:51:14.901344+00:00 Redirected to https://block.fiverr.com?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
I 2024-02-14 12:51:14.901811+00:00 Received 403
W 2024-02-14 12:51:14.901923+00:00 Couldn't resolve URL https://www.fiverr.com/s/p6LNxR: https://block.fiverr.com?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
D 2024-02-14 12:51:14.903081+00:00 fetching author url https://block.fiverr.com?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
I 2024-02-14 12:51:14.903236+00:00 requests.get https://block.fiverr.com?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6 {'gateway': False, 'headers': {}}
I 2024-02-14 12:51:15.304552+00:00 Redirected to https://block.fiverr.com/?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
I 2024-02-14 12:51:15.323717+00:00 Received 403
I 2024-02-14 12:51:15.332494+00:00 Could not fetch author url https://block.fiverr.com?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://block.fiverr.com/?url=aHR0cHM6Ly93d3cuZml2ZXJyLmNvbS9zL3A2TE54Ug%3D%3D&uuid=bcc9f2a7-cb37-11ee-a8ba-7b0b769357f6
I 2024-02-14 12:51:15.347878+00:00 requests.head https://trello.com/b/gmVCR4qD/editing-commissions {'headers': {}}
I 2024-02-14 12:51:15.807385+00:00 Received 200
D 2024-02-14 12:51:15.808514+00:00 fetching author url https://trello.com/b/gmVCR4qD/editing-commissions
I 2024-02-14 12:51:15.808680+00:00 requests.get https://trello.com/b/gmVCR4qD/editing-commissions {'gateway': False, 'headers': {}}
I 2024-02-14 12:51:16.260552+00:00 Received 200
D 2024-02-14 12:51:16.274052+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-14 12:51:16.275052+00:00 requests.head https://twittodon.com/share.php?t=therman98&amp%3Bm=therman%40vt.social {'headers': {}}
I 2024-02-14 12:51:16.926143+00:00 Redirected to https://twittodon.com
I 2024-02-14 12:51:16.926548+00:00 Received 200
D 2024-02-14 12:51:16.926656+00:00 Resolved https://twittodon.com/share.php?t=therman98&amp%3Bm=therman%40vt.social to https://twittodon.com
D 2024-02-14 12:51:16.927627+00:00 fetching author url https://twittodon.com
I 2024-02-14 12:51:16.927759+00:00 requests.get https://twittodon.com {'gateway': False, 'headers': {}}
I 2024-02-14 12:51:17.402223+00:00 Redirected to https://twittodon.com/
I 2024-02-14 12:51:17.402808+00:00 Received 200
D 2024-02-14 12:51:17.409733+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-14 12:51:17.410367+00:00 requests.head https://therman.eu/ {'headers': {}}
I 2024-02-14 12:51:17.964083+00:00 Received 200
D 2024-02-14 12:51:17.983327+00:00 fetching author url https://therman.eu/
I 2024-02-14 12:51:17.983628+00:00 requests.get https://therman.eu/ {'gateway': False, 'headers': {}}
I 2024-02-14 12:51:18.278835+00:00 Received 200
D 2024-02-14 12:51:18.466349+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-14 12:51:18.468175+00:00 posse post discovery found no relationship for https://vt.social/@TheRMan/111925224776249005
I 2024-02-14 12:51:18.974618+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 1970-01-01 00:00:00+00:00
I 2024-02-14 12:51:18.998855+00:00 Updating @TheRMan@vt.social (Mastodon) /mastodon/@therman@vt.social : {'last_public_post': datetime.datetime(2024, 2, 14, 11, 1, 11, 339000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 14, 12, 51, 2, 62363, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-14 12:51:19.105337+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/33511108853737229331 with ETA 1708013479: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ciALEghNYXN0b2RvbiISQHRoZXJtYW5AdnQuc29jaWFsDA&last_polled=2024-02-14-12-51-02', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708013479
}