D 2024-02-19 08:31:36.006728+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-18-03-54-47')]
I 2024-02-19 08:31:36.043908+00:00 Source: @brad@bne.social (Mastodon) @brad@bne.social, https://brid.gy/mastodon/@brad@bne.social
I 2024-02-19 08:31:36.044280+00:00 Last poll: https://brid.gy/log?start_time=1708228487&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGJyYWRAYm5lLnNvY2lhbAw
I 2024-02-19 08:31:36.058235+00:00 Updating @brad@bne.social (Mastodon) /mastodon/@brad@bne.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 19, 8, 31, 36, 44382, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-19 08:31:36.237515+00:00 no refresh_token
I 2024-02-19 08:31:36.255542+00:00 requests.get https://bne.social/api/v1/accounts/109277231880074032/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-19 08:31:37.749179+00:00 Redirected to https://bne.social/api/v1/accounts/109277231880074032/statuses?limit=30
I 2024-02-19 08:31:37.751280+00:00 Received 200
I 2024-02-19 08:31:37.756117+00:00 requests.get https://bne.social/api/v1/statuses/111955978730826364/context {'headers': {'Authorization': '...'}}
I 2024-02-19 08:31:39.084387+00:00 Received 200
I 2024-02-19 08:31:39.088924+00:00 requests.get https://bne.social/api/v1/statuses/111955978730826364/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-19 08:31:39.904416+00:00 Received 200
I 2024-02-19 08:31:39.920875+00:00 requests.get https://bne.social/api/v1/statuses/111952239211328973/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-19 08:31:41.313203+00:00 Received 200
I 2024-02-19 08:31:41.436253+00:00 requests.get https://bne.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-19 08:31:43.917810+00:00 Redirected to https://bne.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-19 08:31:43.921866+00:00 Received 200
I 2024-02-19 08:31:44.026493+00:00 Found 47 public activities: dict_keys(['tag:bne.social,2013:111955978730826364', 'tag:bne.social,2013:111955909033017325', 'tag:bne.social,2013:111952239211328973', 'tag:bne.social,2013:111952204450114517', 'tag:bne.social,2013:111951893988020800', 'tag:bne.social,2013:111951230078251166', 'tag:bne.social,2013:111949673107009408', 'tag:bne.social,2013:111949496142544646', 'tag:bne.social,2013:111946871591044189', 'tag:bne.social,2013:111940561594831205', 'tag:bne.social,2013:111939994114953672', 'tag:bne.social,2013:111939743053861589', 'tag:bne.social,2013:111938241506202289', 'tag:bne.social,2013:111937514106350027', 'tag:bne.social,2013:111933744207049922', 'tag:bne.social,2013:111932634169444126', 'tag:bne.social,2013:111929550548226010', 'tag:bne.social,2013:111929067880398119', 'tag:bne.social,2013:111928533564153382', 'tag:bne.social,2013:111922129698678598', 'tag:bne.social,2013:111921692098338194', 'tag:bne.social,2013:111916608100345790', 'tag:bne.social,2013:111915704123104388', 'tag:bne.social,2013:111915457558646886', 'tag:bne.social,2013:111911351630395381', 'tag:bne.social,2013:111956277373236427', 'tag:bne.social,2013:111950323302585343', 'tag:bne.social,2013:111949521664902403', 'tag:bne.social,2013:111949516083903793', 'tag:bne.social,2013:111941513522307795', 'tag:bne.social,2013:111940714760201183', 'tag:bne.social,2013:111940042262187274', 'tag:bne.social,2013:111939990673172240', 'tag:bne.social,2013:111939750664713873', 'tag:bne.social,2013:111938387759142438', 'tag:bne.social,2013:111937842115555191', 'tag:bne.social,2013:111933055453245847', 'tag:bne.social,2013:111931726768107917', 'tag:bne.social,2013:111928553161508538', 'tag:bne.social,2013:111924275685732134', 'tag:bne.social,2013:111923323893082561', 'tag:bne.social,2013:111915785121762233', 'tag:bne.social,2013:111860986851970064', 'tag:bne.social,2013:111855029708258451', 'tag:bne.social,2013:111850867865699306', 'tag:bne.social,2013:111850832471971644', 'tag:bne.social,2013:111850253829459172'])
I 2024-02-19 08:31:44.026721+00:00 Found 13 private activities: dict_keys(['tag:bne.social,2013:111955906439905762', 'tag:bne.social,2013:111939986747851266', 'tag:bne.social,2013:111928200450497725', 'tag:bne.social,2013:111922579550337742', 'tag:bne.social,2013:111922098598851130', 'tag:bne.social,2013:111894650712161184', 'tag:bne.social,2013:111890112022569708', 'tag:bne.social,2013:111883674392178185', 'tag:bne.social,2013:111883329085874612', 'tag:bne.social,2013:111861399488066641', 'tag:bne.social,2013:111856374025657090', 'tag:bne.social,2013:111856277419440814', 'tag:bne.social,2013:111855236014996371'])
D 2024-02-19 08:31:44.035602+00:00 discovering original posts for: https://bne.social/@brad/111955978730826364
I 2024-02-19 08:31:44.036056+00:00 requests.head https://mastodon.au/@lang {'headers': {}}
I 2024-02-19 08:31:44.856444+00:00 Received 200
I 2024-02-19 08:31:44.856886+00:00 Original post discovery found original posts set(), mentions {'https://mastodon.au/@lang'}
I 2024-02-19 08:31:44.857244+00:00 requests.head https://bne.social/@brad/111955978730826364 {'headers': None}
I 2024-02-19 08:31:45.674812+00:00 Received 200
I 2024-02-19 08:31:45.675090+00:00 starting posse post discovery with syndicated https://bne.social/@brad/111955978730826364
I 2024-02-19 08:31:45.711308+00:00 requests.head https://bradparker.com/ {'headers': {}}
I 2024-02-19 08:31:46.744326+00:00 Received 200
D 2024-02-19 08:31:46.745631+00:00 fetching author url https://bradparker.com/
I 2024-02-19 08:31:46.745866+00:00 requests.get https://bradparker.com/ {'gateway': False, 'headers': {}}
I 2024-02-19 08:31:47.837819+00:00 Received 200
D 2024-02-19 08:31:47.856150+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-19 08:31:47.856937+00:00 requests.head https://toot.cafe/@brad {'headers': {}}
I 2024-02-19 08:31:48.331600+00:00 Received 200
D 2024-02-19 08:31:48.332587+00:00 fetching author url https://toot.cafe/@brad
I 2024-02-19 08:31:48.332758+00:00 requests.get https://toot.cafe/@brad {'gateway': False, 'headers': {}}
I 2024-02-19 08:31:48.906132+00:00 Received 200
D 2024-02-19 08:31:48.913769+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-19 08:31:48.914576+00:00 requests.head https://pronoun.is/he {'headers': {}}
I 2024-02-19 08:31:49.575555+00:00 Received 404
W 2024-02-19 08:31:49.604866+00:00 Couldn't resolve URL https://pronoun.is/he: https://pronoun.is/he
D 2024-02-19 08:31:49.605915+00:00 fetching author url https://pronoun.is/he
I 2024-02-19 08:31:49.606151+00:00 requests.get https://pronoun.is/he {'gateway': False, 'headers': {}}
I 2024-02-19 08:31:50.484081+00:00 Received 503
I 2024-02-19 08:31:50.484436+00:00 Could not fetch author url https://pronoun.is/he
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://pronoun.is/he
D 2024-02-19 08:31:50.489067+00:00 posse post discovery found no relationship for https://bne.social/@brad/111955978730826364
D 2024-02-19 08:31:51.406646+00:00 discovering original posts for: https://bne.social/@brad/111952239211328973
I 2024-02-19 08:31:51.407317+00:00 requests.head https://bne.social/@simon {'headers': {}}
I 2024-02-19 08:31:52.319360+00:00 Received 200
I 2024-02-19 08:31:52.320065+00:00 Original post discovery found original posts set(), mentions {'https://bne.social/@simon'}
I 2024-02-19 08:31:52.322942+00:00 requests.head https://bne.social/@brad/111952239211328973 {'headers': None}
I 2024-02-19 08:31:53.630638+00:00 Received 200
I 2024-02-19 08:31:53.630919+00:00 starting posse post discovery with syndicated https://bne.social/@brad/111952239211328973
D 2024-02-19 08:31:53.733050+00:00 skipping https://bradparker.com/, already fetched this round
D 2024-02-19 08:31:53.733278+00:00 skipping https://toot.cafe/@brad, already fetched this round
D 2024-02-19 08:31:53.733371+00:00 skipping https://pronoun.is/he, already fetched this round
D 2024-02-19 08:31:53.733454+00:00 posse post discovery found no relationship for https://bne.social/@brad/111952239211328973
I 2024-02-19 08:31:53.944788+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2022-11-21 06:22:43.218422+00:00
I 2024-02-19 08:31:53.955890+00:00 Updating @brad@bne.social (Mastodon) /mastodon/@brad@bne.social : {'last_public_post': datetime.datetime(2024, 2, 19, 4, 33, 39), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 19, 8, 31, 36, 44382, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-19 08:31:54.051553+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/00564145271669483301 with ETA 1708404634: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGJyYWRAYm5lLnNvY2lhbAw&last_polled=2024-02-19-08-31-36', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708404634
}