D 2024-02-09 13:13:36.008079+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-08-09-38-31')]
I 2024-02-09 13:13:36.024968+00:00 Source: @fetzert@mastodon.social (Mastodon) @fetzert@mastodon.social, https://brid.gy/mastodon/@fetzert@mastodon.social
I 2024-02-09 13:13:36.026241+00:00 Last poll: https://brid.gy/log?start_time=1707385111&key=agdicmlkLWd5ciYLEghNYXN0b2RvbiIYQGZldHplcnRAbWFzdG9kb24uc29jaWFsDA
I 2024-02-09 13:13:36.047105+00:00 Updating @fetzert@mastodon.social (Mastodon) /mastodon/@fetzert@mastodon.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 9, 13, 13, 36, 26695, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-09 13:13:36.142681+00:00 no refresh_token
I 2024-02-09 13:13:36.170783+00:00 requests.get https://mastodon.social/api/v1/accounts/110000089638610096/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-09 13:13:37.051564+00:00 Redirected to https://mastodon.social/api/v1/accounts/110000089638610096/statuses?limit=30
I 2024-02-09 13:13:37.051805+00:00 Received 200
I 2024-02-09 13:13:37.158261+00:00 requests.get https://mastodon.social/api/v1/statuses/111827193946373642/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-09 13:13:37.773782+00:00 Received 200
I 2024-02-09 13:13:37.861900+00:00 requests.get https://mastodon.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-09 13:13:39.599141+00:00 Redirected to https://mastodon.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-09 13:13:39.599408+00:00 Received 200
I 2024-02-09 13:13:39.776209+00:00 Found 67 public activities: dict_keys(['tag:mastodon.social,2013:111898539058169747', 'tag:mastodon.social,2013:111849843182590171', 'tag:mastodon.social,2013:111827193946373642', 'tag:mastodon.social,2013:111817263015496284', 'tag:mastodon.social,2013:111815869282226472', 'tag:mastodon.social,2013:111424304110863968', 'tag:mastodon.social,2013:111294700698807785', 'tag:mastodon.social,2013:111289360343857299', 'tag:mastodon.social,2013:111220261901417927', 'tag:mastodon.social,2013:111220209084651798', 'tag:mastodon.social,2013:111220190918965785', 'tag:mastodon.social,2013:111217189862992307', 'tag:mastodon.social,2013:111173163144180720', 'tag:mastodon.social,2013:111164467667388808', 'tag:mastodon.social,2013:111160347192181187', 'tag:mastodon.social,2013:111158465426176126', 'tag:mastodon.social,2013:111144595308467798', 'tag:mastodon.social,2013:111127683330783410', 'tag:mastodon.social,2013:111125685517880577', 'tag:mastodon.social,2013:111112201198224193', 'tag:mastodon.social,2013:111103488680483536', 'tag:mastodon.social,2013:111051190498768573', 'tag:mastodon.social,2013:111050823695543628', 'tag:mastodon.social,2013:111045063376506085', 'tag:mastodon.social,2013:111044948823100266', 'tag:mastodon.social,2013:111044920930728311', 'tag:mastodon.social,2013:111044910902421645', 'tag:mastodon.social,2013:110976257838763802', 'tag:mastodon.social,2013:110957024618908068', 'tag:mastodon.social,2013:110956920350161051', 'tag:mastodon.social,2013:111382817555426416', 'tag:mastodon.social,2013:111126473965654461', 'tag:mastodon.social,2013:111044942863752598', 'tag:mastodon.social,2013:111044918717350679', 'tag:mastodon.social,2013:111044914111278017', 'tag:mastodon.social,2013:110973638604218642', 'tag:mastodon.social,2013:110973316876960572', 'tag:mastodon.social,2013:110973339787887257', 'tag:mastodon.social,2013:110962121010162005', 'tag:mastodon.social,2013:110962120787230236', 'tag:mastodon.social,2013:110962120750401925', 'tag:mastodon.social,2013:110962120363840605', 'tag:mastodon.social,2013:110957287730938917', 'tag:mastodon.social,2013:110957010058402916', 'tag:mastodon.social,2013:110917934279181456', 'tag:mastodon.social,2013:110917465057535010', 'tag:mastodon.social,2013:110917413033089077', 'tag:mastodon.social,2013:110866506163053772', 'tag:mastodon.social,2013:110865395300859149', 'tag:mastodon.social,2013:110858872448274102', 'tag:mastodon.social,2013:110857979969698798', 'tag:mastodon.social,2013:110797641032415743', 'tag:mastodon.social,2013:110797623194167954', 'tag:mastodon.social,2013:110797466827884285', 'tag:mastodon.social,2013:110796455191472522', 'tag:mastodon.social,2013:110793187792745966', 'tag:mastodon.social,2013:110773786682135244', 'tag:mastodon.social,2013:110762646739795559', 'tag:mastodon.social,2013:110725929935813418', 'tag:mastodon.social,2013:110724902752762600', 'tag:mastodon.social,2013:110722992383333693', 'tag:mastodon.social,2013:110711819912136191', 'tag:mastodon.social,2013:110711575596921010', 'tag:mastodon.social,2013:110711524680080148', 'tag:mastodon.social,2013:110711462992355735', 'tag:mastodon.social,2013:110709550399387094', 'tag:mastodon.social,2013:110709079524753196'])
I 2024-02-09 13:13:39.776511+00:00 Found 3 private activities: dict_keys(['tag:mastodon.social,2013:111883918118275863', 'tag:mastodon.social,2013:110966910269017534', 'tag:mastodon.social,2013:110711529967523784'])
D 2024-02-09 13:13:39.780542+00:00 discovering original posts for: https://mastodon.social/@fetzert/111827193946373642
I 2024-02-09 13:13:39.781181+00:00 requests.head https://warwick.ac.uk/fac/soc/economics/research/centres/cage/publications/workingpapers/2024/informational_boundaries_of_the_state/ {'headers': {}}
I 2024-02-09 13:13:40.661800+00:00 Received 200
I 2024-02-09 13:13:40.662175+00:00 Original post discovery found original posts {'https://warwick.ac.uk/fac/soc/economics/research/centres/cage/publications/workingpapers/2024/informational_boundaries_of_the_state/'}, mentions set()
I 2024-02-09 13:13:40.663227+00:00 requests.head https://mastodon.social/@fetzert/111827193946373642 {'headers': None}
I 2024-02-09 13:13:41.260509+00:00 Received 200
I 2024-02-09 13:13:41.260830+00:00 starting posse post discovery with syndicated https://mastodon.social/@fetzert/111827193946373642
I 2024-02-09 13:13:41.355991+00:00 requests.head https://warwick.ac.uk/fac/soc/economics/staff/tfetzer/ {'headers': {}}
I 2024-02-09 13:13:42.134436+00:00 Received 200
D 2024-02-09 13:13:42.135596+00:00 fetching author url https://warwick.ac.uk/fac/soc/economics/staff/tfetzer/
I 2024-02-09 13:13:42.135794+00:00 requests.get https://warwick.ac.uk/fac/soc/economics/staff/tfetzer/ {'gateway': False, 'headers': {}}
I 2024-02-09 13:13:43.767665+00:00 Received 200
D 2024-02-09 13:13:43.960314+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-09 13:13:43.961142+00:00 requests.head https://www.trfetzer.com/ {'headers': {}}
I 2024-02-09 13:13:45.655470+00:00 Received 200
D 2024-02-09 13:13:45.656539+00:00 fetching author url https://www.trfetzer.com/
I 2024-02-09 13:13:45.656734+00:00 requests.get https://www.trfetzer.com/ {'gateway': False, 'headers': {}}
I 2024-02-09 13:13:47.242604+00:00 Received 200
D 2024-02-09 13:13:47.253582+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-09 13:13:47.254984+00:00 requests.head https://ideas.repec.org/f/pfe231.htm {'headers': {}}
I 2024-02-09 13:13:49.057617+00:00 Received 404
W 2024-02-09 13:13:49.057831+00:00 Couldn't resolve URL https://ideas.repec.org/f/pfe231.htm: https://ideas.repec.org/f/pfe231.htm
D 2024-02-09 13:13:49.058817+00:00 fetching author url https://ideas.repec.org/f/pfe231.htm
I 2024-02-09 13:13:49.059061+00:00 requests.get https://ideas.repec.org/f/pfe231.htm {'gateway': False, 'headers': {}}
I 2024-02-09 13:13:49.787342+00:00 Received 404
I 2024-02-09 13:13:49.788020+00:00 Could not fetch author url https://ideas.repec.org/f/pfe231.htm
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://ideas.repec.org/f/pfe231.htm
D 2024-02-09 13:13:49.857613+00:00 posse post discovery found no relationship for https://mastodon.social/@fetzert/111827193946373642
I 2024-02-09 13:13:50.014225+00:00 https://mastodon.social/@fetzert/111827193946373642 has 1 webmention target(s): https://warwick.ac.uk/fac/soc/economics/research/centres/cage/publications/workingpapers/2024/informational_boundaries_of_the_state/
I 2024-02-09 13:13:50.014467+00:00 requests.get https://mastodon.social/api/v1/blocks?limit=100 {'headers': {'Authorization': '...'}}
I 2024-02-09 13:13:51.272938+00:00 Received 200
D 2024-02-09 13:13:51.438841+00:00 New webmentions to propagate! Response repost tag:mastodon.social,2013:111827193946373642_reblogged_by_110000089638610096 https://mastodon.social/@fetzert/111827193946373642#reblogged-by-110000089638610096
I 2024-02-09 13:13:51.467788+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/186562354194959573 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5clkLEghSZXNwb25zZSJLdGFnOm1hc3RvZG9uLnNvY2lhbCwyMDEzOjExMTgyNzE5Mzk0NjM3MzY0Ml9yZWJsb2dnZWRfYnlfMTEwMDAwMDg5NjM4NjEwMDk2DA', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-02-09 13:13:51.525339+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-09-11 05:41:40.794250+00:00
I 2024-02-09 13:13:51.558136+00:00 Updating @fetzert@mastodon.social (Mastodon) /mastodon/@fetzert@mastodon.social : {'last_public_post': datetime.datetime(2024, 1, 31, 9, 26, 3, 801000), 'recent_private_posts': 1, 'last_polled': datetime.datetime(2024, 2, 9, 13, 13, 36, 26695, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-09 13:13:51.671766+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/76686852833213742301 with ETA 1707571508: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ciYLEghNYXN0b2RvbiIYQGZldHplcnRAbWFzdG9kb24uc29jaWFsDA&last_polled=2024-02-09-13-13-36', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707571508
}