D 2024-01-20 11:06:10.008640+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-01-20-10-35-48')]
I 2024-01-20 11:06:10.035361+00:00 Source: @thomasottio@mastodon.social (Mastodon) @thomasottio@mastodon.social, https://brid.gy/mastodon/@thomasottio@mastodon.social
I 2024-01-20 11:06:10.035741+00:00 Last poll: https://brid.gy/log?start_time=1705746948&key=agdicmlkLWd5cioLEghNYXN0b2RvbiIcQHRob21hc290dGlvQG1hc3RvZG9uLnNvY2lhbAw
I 2024-01-20 11:06:10.060089+00:00 Updating @thomasottio@mastodon.social (Mastodon) /mastodon/@thomasottio@mastodon.social : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 1, 20, 11, 6, 10, 35843, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-01-20 11:06:10.174762+00:00 no refresh_token
I 2024-01-20 11:06:10.193156+00:00 requests.get https://mastodon.social/api/v1/accounts/109241122885399275/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-01-20 11:06:11.074583+00:00 Redirected to https://mastodon.social/api/v1/accounts/109241122885399275/statuses?limit=30
I 2024-01-20 11:06:11.074845+00:00 Received 200
I 2024-01-20 11:06:11.234179+00:00 requests.get https://mastodon.social/api/v1/statuses/111787841188184047/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-01-20 11:06:11.775821+00:00 Received 200
I 2024-01-20 11:06:12.016655+00:00 requests.get https://mastodon.social/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-01-20 11:06:13.570028+00:00 Redirected to https://mastodon.social/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-01-20 11:06:13.570296+00:00 Received 200
I 2024-01-20 11:06:14.216198+00:00 Found 66 public activities: dict_keys(['tag:mastodon.social,2013:111787841188184047', 'tag:mastodon.social,2013:111783360472589131', 'tag:mastodon.social,2013:111782934927617448', 'tag:mastodon.social,2013:111782916922699020', 'tag:mastodon.social,2013:111782914170832954', 'tag:mastodon.social,2013:111782214392063530', 'tag:mastodon.social,2013:111772975782740575', 'tag:mastodon.social,2013:111766090479032673', 'tag:mastodon.social,2013:111751627578330247', 'tag:mastodon.social,2013:111748792983755023', 'tag:mastodon.social,2013:111744785433519290', 'tag:mastodon.social,2013:111744744218594676', 'tag:mastodon.social,2013:111736966962021720', 'tag:mastodon.social,2013:111736954081161409', 'tag:mastodon.social,2013:111726605586634768', 'tag:mastodon.social,2013:111714353386955861', 'tag:mastodon.social,2013:111708651685673506', 'tag:mastodon.social,2013:111705168069362188', 'tag:mastodon.social,2013:111702957671666520', 'tag:mastodon.social,2013:111698522024691708', 'tag:mastodon.social,2013:111693628785808329', 'tag:mastodon.social,2013:111688841307969370', 'tag:mastodon.social,2013:111685885964996690', 'tag:mastodon.social,2013:111674760699993951', 'tag:mastodon.social,2013:111674757281203891', 'tag:mastodon.social,2013:111659328187665338', 'tag:mastodon.social,2013:111652105563717708', 'tag:mastodon.social,2013:111649770107277285', 'tag:mastodon.social,2013:111648026836288873', 'tag:mastodon.social,2013:111714982740109913', 'tag:mastodon.social,2013:111660142672099438', 'tag:mastodon.social,2013:111660130953370646', 'tag:mastodon.social,2013:111645953816025483', 'tag:mastodon.social,2013:111641332628239318', 'tag:mastodon.social,2013:111641237074915999', 'tag:mastodon.social,2013:111637318193490320', 'tag:mastodon.social,2013:111624758537684302', 'tag:mastodon.social,2013:111623814561822802', 'tag:mastodon.social,2013:111623800564300450', 'tag:mastodon.social,2013:111615194741594917', 'tag:mastodon.social,2013:111613878085692829', 'tag:mastodon.social,2013:111613864449175251', 'tag:mastodon.social,2013:111613853432324703', 'tag:mastodon.social,2013:111613006231221297', 'tag:mastodon.social,2013:111612992490899927', 'tag:mastodon.social,2013:111611214173041601', 'tag:mastodon.social,2013:111609566395106497', 'tag:mastodon.social,2013:111608252573536268', 'tag:mastodon.social,2013:111608218877027085', 'tag:mastodon.social,2013:111608151830343923', 'tag:mastodon.social,2013:111608134775515780', 'tag:mastodon.social,2013:111607925956304649', 'tag:mastodon.social,2013:111607852521218878', 'tag:mastodon.social,2013:111607848161321946', 'tag:mastodon.social,2013:111607730141734034', 'tag:mastodon.social,2013:111607704876276723', 'tag:mastodon.social,2013:111607702773494624', 'tag:mastodon.social,2013:111607686505272986', 'tag:mastodon.social,2013:111607675766642625', 'tag:mastodon.social,2013:111607668147389999', 'tag:mastodon.social,2013:111607660731184033', 'tag:mastodon.social,2013:111607608647701517', 'tag:mastodon.social,2013:111606997131169538', 'tag:mastodon.social,2013:111562604594753342', 'tag:mastodon.social,2013:111556692156717259', 'tag:mastodon.social,2013:111545591004402504'])
I 2024-01-20 11:06:14.216519+00:00 Found 3 private activities: dict_keys(['tag:mastodon.social,2013:111642565906841848', 'tag:mastodon.social,2013:111641790100596843', 'tag:mastodon.social,2013:111640887757388923'])
D 2024-01-20 11:06:14.224148+00:00 discovering original posts for: https://mastodon.social/@thomasottio/111787841188184047
I 2024-01-20 11:06:14.224820+00:00 requests.head https://www.neuralmarkettrends.com/rebasing-time-series-with-python/ {'headers': {}}
I 2024-01-20 11:06:15.120469+00:00 Received 200
I 2024-01-20 11:06:15.120801+00:00 requests.head https://mastodon.social/tags/tutorial {'headers': {'User-Agent': '...'}}
I 2024-01-20 11:06:15.624408+00:00 Received 200
I 2024-01-20 11:06:15.624711+00:00 requests.head https://mastodon.social/tags/Python {'headers': {'User-Agent': '...'}}
I 2024-01-20 11:06:16.146079+00:00 Received 200
I 2024-01-20 11:06:16.146401+00:00 requests.head https://mastodon.social/tags/stock {'headers': {'User-Agent': '...'}}
I 2024-01-20 11:06:16.690804+00:00 Received 200
I 2024-01-20 11:06:16.691130+00:00 requests.head https://www/ {'headers': {'User-Agent': '...'}}
W 2024-01-20 11:06:16.739770+00:00 Couldn't resolve URL https://www/ : HTTPSConnectionPool(host='www', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3ecf1825c410>: Failed to resolve 'www' ([Errno -3] Temporary failure in name resolution)"))
W 2024-01-20 11:06:16.740351+00:00 Couldn't resolve URL https://www/: https://www/
I 2024-01-20 11:06:16.740760+00:00 Original post discovery found original posts {'https://www.neuralmarkettrends.com/rebasing-time-series-with-python/'}, mentions {'https://mastodon.social/tags/tutorial', 'https://mastodon.social/tags/stock', 'https://mastodon.social/tags/Python'}
I 2024-01-20 11:06:16.742076+00:00 requests.head https://mastodon.social/@thomasottio/111787841188184047 {'headers': None}
I 2024-01-20 11:06:17.214538+00:00 Received 200
I 2024-01-20 11:06:17.214830+00:00 starting posse post discovery with syndicated https://mastodon.social/@thomasottio/111787841188184047
I 2024-01-20 11:06:17.243495+00:00 requests.head https://www.thomasott.io/ {'headers': {}}
I 2024-01-20 11:06:17.652100+00:00 Received 200
D 2024-01-20 11:06:17.653122+00:00 fetching author url https://www.thomasott.io/
I 2024-01-20 11:06:17.653318+00:00 requests.get https://www.thomasott.io/ {'gateway': False, 'headers': {}}
I 2024-01-20 11:06:18.016483+00:00 Received 200
D 2024-01-20 11:06:18.055625+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-01-20 11:06:18.101711+00:00 requests.head https://www.weathered.pub/ {'headers': {}}
I 2024-01-20 11:06:18.917191+00:00 Received 200
D 2024-01-20 11:06:18.918577+00:00 fetching author url https://www.weathered.pub/
I 2024-01-20 11:06:18.918841+00:00 requests.get https://www.weathered.pub/ {'gateway': False, 'headers': {}}
I 2024-01-20 11:06:19.615803+00:00 Received 200
D 2024-01-20 11:06:19.650679+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-01-20 11:06:19.651556+00:00 requests.head https://neuralmarkettrends.com/ {'headers': {}}
I 2024-01-20 11:06:20.151035+00:00 Received 200
D 2024-01-20 11:06:20.152299+00:00 fetching author url https://neuralmarkettrends.com/
I 2024-01-20 11:06:20.152525+00:00 requests.get https://neuralmarkettrends.com/ {'gateway': False, 'headers': {}}
I 2024-01-20 11:06:20.456345+00:00 Received 200
D 2024-01-20 11:06:20.504220+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-01-20 11:06:20.506165+00:00 requests.head https://writer.thomasott.io/ {'headers': {}}
I 2024-01-20 11:06:20.885201+00:00 Received 404
W 2024-01-20 11:06:20.885434+00:00 Couldn't resolve URL https://writer.thomasott.io/: https://writer.thomasott.io/
D 2024-01-20 11:06:20.886317+00:00 fetching author url https://writer.thomasott.io/
I 2024-01-20 11:06:20.886468+00:00 requests.get https://writer.thomasott.io/ {'gateway': False, 'headers': {}}
I 2024-01-20 11:06:21.288447+00:00 Received 404
I 2024-01-20 11:06:21.288709+00:00 Could not fetch author url https://writer.thomasott.io/
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2224, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://writer.thomasott.io/
D 2024-01-20 11:06:21.305563+00:00 posse post discovery found no relationship for https://mastodon.social/@thomasottio/111787841188184047
I 2024-01-20 11:06:21.457154+00:00 https://mastodon.social/@thomasottio/111787841188184047 has 1 webmention target(s): https://www.neuralmarkettrends.com/rebasing-time-series-with-python/
I 2024-01-20 11:06:21.457464+00:00 requests.get https://mastodon.social/api/v1/blocks?limit=1000 {'headers': {'Authorization': '...'}}
I 2024-01-20 11:06:21.952972+00:00 Received 200
D 2024-01-20 11:06:22.033557+00:00 New webmentions to propagate! Response repost tag:mastodon.social,2013:111787841188184047_reblogged_by_110328860679193176 https://mastodon.social/@thomasottio/111787841188184047#reblogged-by-110328860679193176
I 2024-01-20 11:06:22.063066+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/3515873190316911618 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5clkLEghSZXNwb25zZSJLdGFnOm1hc3RvZG9uLnNvY2lhbCwyMDEzOjExMTc4Nzg0MTE4ODE4NDA0N19yZWJsb2dnZWRfYnlfMTEwMzI4ODYwNjc5MTkzMTc2DA', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-01-20 11:06:22.125606+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2024-01-19 14:53:22.439557+00:00
I 2024-01-20 11:06:22.150357+00:00 Updating @thomasottio@mastodon.social (Mastodon) /mastodon/@thomasottio@mastodon.social : {'last_public_post': datetime.datetime(2024, 1, 20, 10, 38, 8, 629000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 1, 20, 11, 6, 10, 35843, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-01-20 11:06:22.260786+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/5624357600100976891 with ETA 1705750928: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5cioLEghNYXN0b2RvbiIcQHRob21hc290dGlvQG1hc3RvZG9uLnNvY2lhbAw&last_polled=2024-01-20-11-06-10', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1705750928
}