D 2024-02-20 04:50:34.006697+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-19-08-31-36')]
I 2024-02-20 04:50:34.036592+00:00 Source: @brad@bne.social (Mastodon) @brad@bne.social, https://brid.gy/mastodon/@brad@bne.social
I 2024-02-20 04:50:34.036994+00:00 Last poll: https://brid.gy/log?start_time=1708331496&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGJyYWRAYm5lLnNvY2lhbAw
I 2024-02-20 04:50:34.059711+00:00 Updating @brad@bne.social (Mastodon) /mastodon/@brad@bne.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 20, 4, 50, 34, 37104, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-20 04:50:34.159133+00:00 no refresh_token
I 2024-02-20 04:50:34.184783+00:00 requests.get https://bne.social/api/v1/accounts/109277231880074032/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-20 04:50:35.468106+00:00 Redirected to https://bne.social/api/v1/accounts/109277231880074032/statuses?limit=30
I 2024-02-20 04:50:35.470675+00:00 Received 200
I 2024-02-20 04:50:35.475398+00:00 requests.get https://bne.social/api/v1/statuses/111960891934090329/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-20 04:50:36.282207+00:00 Received 200
I 2024-02-20 04:50:36.287113+00:00 requests.get https://bne.social/api/v1/statuses/111958090894892946/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-20 04:50:37.484559+00:00 Received 200
I 2024-02-20 04:50:37.488975+00:00 requests.get https://bne.social/api/v1/statuses/111957979946340806/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-20 04:50:38.363917+00:00 Received 200
I 2024-02-20 04:50:38.397892+00:00 requests.get https://bne.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-20 04:50:40.412502+00:00 Redirected to https://bne.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-20 04:50:40.416796+00:00 Received 200
I 2024-02-20 04:50:40.492127+00:00 Found 45 public activities: dict_keys(['tag:bne.social,2013:111960891934090329', 'tag:bne.social,2013:111955978730826364', 'tag:bne.social,2013:111955909033017325', 'tag:bne.social,2013:111952239211328973', 'tag:bne.social,2013:111952204450114517', 'tag:bne.social,2013:111951893988020800', 'tag:bne.social,2013:111951230078251166', 'tag:bne.social,2013:111949673107009408', 'tag:bne.social,2013:111949496142544646', 'tag:bne.social,2013:111946871591044189', 'tag:bne.social,2013:111940561594831205', 'tag:bne.social,2013:111939994114953672', 'tag:bne.social,2013:111939743053861589', 'tag:bne.social,2013:111938241506202289', 'tag:bne.social,2013:111937514106350027', 'tag:bne.social,2013:111933744207049922', 'tag:bne.social,2013:111932634169444126', 'tag:bne.social,2013:111929550548226010', 'tag:bne.social,2013:111929067880398119', 'tag:bne.social,2013:111928533564153382', 'tag:bne.social,2013:111922129698678598', 'tag:bne.social,2013:111921692098338194', 'tag:bne.social,2013:111916608100345790', 'tag:bne.social,2013:111956277373236427', 'tag:bne.social,2013:111950323302585343', 'tag:bne.social,2013:111949521664902403', 'tag:bne.social,2013:111949516083903793', 'tag:bne.social,2013:111941513522307795', 'tag:bne.social,2013:111940714760201183', 'tag:bne.social,2013:111940042262187274', 'tag:bne.social,2013:111939990673172240', 'tag:bne.social,2013:111939750664713873', 'tag:bne.social,2013:111938387759142438', 'tag:bne.social,2013:111937842115555191', 'tag:bne.social,2013:111933055453245847', 'tag:bne.social,2013:111931726768107917', 'tag:bne.social,2013:111928553161508538', 'tag:bne.social,2013:111924275685732134', 'tag:bne.social,2013:111923323893082561', 'tag:bne.social,2013:111915785121762233', 'tag:bne.social,2013:111860986851970064', 'tag:bne.social,2013:111855029708258451', 'tag:bne.social,2013:111850867865699306', 'tag:bne.social,2013:111850832471971644', 'tag:bne.social,2013:111850253829459172'])
I 2024-02-20 04:50:40.492378+00:00 Found 15 private activities: dict_keys(['tag:bne.social,2013:111958090894892946', 'tag:bne.social,2013:111957979946340806', 'tag:bne.social,2013:111955906439905762', 'tag:bne.social,2013:111939986747851266', 'tag:bne.social,2013:111928200450497725', 'tag:bne.social,2013:111922579550337742', 'tag:bne.social,2013:111922098598851130', 'tag:bne.social,2013:111894650712161184', 'tag:bne.social,2013:111890112022569708', 'tag:bne.social,2013:111883674392178185', 'tag:bne.social,2013:111883329085874612', 'tag:bne.social,2013:111861399488066641', 'tag:bne.social,2013:111856374025657090', 'tag:bne.social,2013:111856277419440814', 'tag:bne.social,2013:111855236014996371'])
D 2024-02-20 04:50:40.495512+00:00 discovering original posts for: https://bne.social/@brad/111960891934090329
I 2024-02-20 04:50:40.495815+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-20 04:50:40.496118+00:00 requests.head https://bne.social/@brad/111960891934090329 {'headers': None}
I 2024-02-20 04:50:41.397558+00:00 Received 200
I 2024-02-20 04:50:41.397868+00:00 starting posse post discovery with syndicated https://bne.social/@brad/111960891934090329
I 2024-02-20 04:50:41.439566+00:00 requests.head https://bradparker.com/ {'headers': {}}
I 2024-02-20 04:50:42.712100+00:00 Received 200
D 2024-02-20 04:50:42.713179+00:00 fetching author url https://bradparker.com/
I 2024-02-20 04:50:42.713350+00:00 requests.get https://bradparker.com/ {'gateway': False, 'headers': {}}
I 2024-02-20 04:50:43.713337+00:00 Received 200
D 2024-02-20 04:50:43.731259+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-20 04:50:43.732032+00:00 requests.head https://toot.cafe/@brad {'headers': {}}
I 2024-02-20 04:50:44.148394+00:00 Received 200
D 2024-02-20 04:50:44.149575+00:00 fetching author url https://toot.cafe/@brad
I 2024-02-20 04:50:44.149842+00:00 requests.get https://toot.cafe/@brad {'gateway': False, 'headers': {}}
I 2024-02-20 04:50:44.468079+00:00 Received 200
D 2024-02-20 04:50:44.474310+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-20 04:50:44.475254+00:00 requests.head https://pronoun.is/he {'headers': {}}
I 2024-02-20 04:50:44.940149+00:00 Received 404
W 2024-02-20 04:50:44.940412+00:00 Couldn't resolve URL https://pronoun.is/he: https://pronoun.is/he
D 2024-02-20 04:50:44.941343+00:00 fetching author url https://pronoun.is/he
I 2024-02-20 04:50:44.941498+00:00 requests.get https://pronoun.is/he {'gateway': False, 'headers': {}}
I 2024-02-20 04:50:45.392272+00:00 Received 404
I 2024-02-20 04:50:45.392542+00:00 Could not fetch author url https://pronoun.is/he
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://pronoun.is/he
D 2024-02-20 04:50:45.395995+00:00 posse post discovery found no relationship for https://bne.social/@brad/111960891934090329
I 2024-02-20 04:50:45.720658+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2022-11-21 06:22:43.218422+00:00
I 2024-02-20 04:50:45.746865+00:00 Updating @brad@bne.social (Mastodon) /mastodon/@brad@bne.social : {'last_public_post': datetime.datetime(2024, 2, 20, 0, 7, 13, 273000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 20, 4, 50, 34, 37104, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-20 04:50:45.844120+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/92389930776939691011 with ETA 1708502356: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGJyYWRAYm5lLnNvY2lhbAw&last_polled=2024-02-20-04-50-34', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708502356
}