D 2024-02-13 02:21:57.007899+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-11-23-08-31')]
I 2024-02-13 02:21:57.027218+00:00 Source: @suitbertmonz@social.tchncs.de (Mastodon) @suitbertmonz@social.tchncs.de, https://brid.gy/mastodon/@suitbertmonz@social.tchncs.de
I 2024-02-13 02:21:57.027677+00:00 Last poll: https://brid.gy/log?start_time=1707692911&key=agdicmlkLWd5ciwLEghNYXN0b2RvbiIeQHN1aXRiZXJ0bW9uekBzb2NpYWwudGNobmNzLmRlDA
I 2024-02-13 02:21:57.057853+00:00 Updating @suitbertmonz@social.tchncs.de (Mastodon) /mastodon/@suitbertmonz@social.tchncs.de : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 13, 2, 21, 57, 27844, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-13 02:21:57.160530+00:00 no refresh_token
I 2024-02-13 02:21:57.192108+00:00 requests.get https://social.tchncs.de/api/v1/accounts/22275/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-13 02:21:58.318250+00:00 Redirected to https://social.tchncs.de/api/v1/accounts/22275/statuses?limit=30
I 2024-02-13 02:21:58.323688+00:00 Received 200
I 2024-02-13 02:21:58.332932+00:00 requests.get https://social.tchncs.de/api/v1/statuses/111917800232119924/context {'headers': {'Authorization': '...'}}
I 2024-02-13 02:21:59.087228+00:00 Received 200
I 2024-02-13 02:21:59.095304+00:00 requests.get https://social.tchncs.de/api/v1/statuses/111903166324042503/favourited_by {'headers': {'Authorization': '...'}}
I 2024-02-13 02:21:59.763744+00:00 Received 200
I 2024-02-13 02:21:59.955847+00:00 requests.get https://social.tchncs.de/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-13 02:22:01.389495+00:00 Redirected to https://social.tchncs.de/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-13 02:22:01.401403+00:00 Received 200
I 2024-02-13 02:22:01.579412+00:00 Found 67 public activities: dict_keys(['tag:social.tchncs.de,2013:111917800232119924', 'tag:social.tchncs.de,2013:111906953222573951', 'tag:social.tchncs.de,2013:111903166324042503', 'tag:social.tchncs.de,2013:111888918807714172', 'tag:social.tchncs.de,2013:111872742770132892', 'tag:social.tchncs.de,2013:111868170192960533', 'tag:social.tchncs.de,2013:111863176681404966', 'tag:social.tchncs.de,2013:111862904691315642', 'tag:social.tchncs.de,2013:111862855636283461', 'tag:social.tchncs.de,2013:111857295486832570', 'tag:social.tchncs.de,2013:111855766174116977', 'tag:social.tchncs.de,2013:111855543992727160', 'tag:social.tchncs.de,2013:111839996151356428', 'tag:social.tchncs.de,2013:111823604702860271', 'tag:social.tchncs.de,2013:111793877136620451', 'tag:social.tchncs.de,2013:111787822494499415', 'tag:social.tchncs.de,2013:111781753734442325', 'tag:social.tchncs.de,2013:111771840056200688', 'tag:social.tchncs.de,2013:111738337769488715', 'tag:social.tchncs.de,2013:111738266972102487', 'tag:social.tchncs.de,2013:111736787512150164', 'tag:social.tchncs.de,2013:111724685038937382', 'tag:social.tchncs.de,2013:111704664943171545', 'tag:social.tchncs.de,2013:111651467046449533', 'tag:social.tchncs.de,2013:111642073578738558', 'tag:social.tchncs.de,2013:111623598661599253', 'tag:social.tchncs.de,2013:111619488380595032', 'tag:social.tchncs.de,2013:111597444979644691', 'tag:social.tchncs.de,2013:111595206725187691', 'tag:social.tchncs.de,2013:111589444654858358', 'tag:social.tchncs.de,2013:111653649804693475', 'tag:social.tchncs.de,2013:111642187172299072', 'tag:social.tchncs.de,2013:111642145031660023', 'tag:social.tchncs.de,2013:111642128918782969', 'tag:social.tchncs.de,2013:111642095817249271', 'tag:social.tchncs.de,2013:111623602351663255', 'tag:social.tchncs.de,2013:111516644166196044', 'tag:social.tchncs.de,2013:111515903346565647', 'tag:social.tchncs.de,2013:111515865666772981', 'tag:social.tchncs.de,2013:111413898596740046', 'tag:social.tchncs.de,2013:111413408477571109', 'tag:social.tchncs.de,2013:111387380498328090', 'tag:social.tchncs.de,2013:111363457146333990', 'tag:social.tchncs.de,2013:111279703417002197', 'tag:social.tchncs.de,2013:111217368715452085', 'tag:social.tchncs.de,2013:111198834334811799', 'tag:social.tchncs.de,2013:111194441179182028', 'tag:social.tchncs.de,2013:111193242321827972', 'tag:social.tchncs.de,2013:111158803345523278', 'tag:social.tchncs.de,2013:111158577110567442', 'tag:social.tchncs.de,2013:111154678834241705', 'tag:social.tchncs.de,2013:111141191479010299', 'tag:social.tchncs.de,2013:111138264314099777', 'tag:social.tchncs.de,2013:111104772702315517', 'tag:social.tchncs.de,2013:111064835908236522', 'tag:social.tchncs.de,2013:111058826100560661', 'tag:social.tchncs.de,2013:110973466076744124', 'tag:social.tchncs.de,2013:110967398895372667', 'tag:social.tchncs.de,2013:110960785956493902', 'tag:social.tchncs.de,2013:110921440950670230', 'tag:social.tchncs.de,2013:110915083239142559', 'tag:social.tchncs.de,2013:110915071873579448', 'tag:social.tchncs.de,2013:110876154577256421', 'tag:social.tchncs.de,2013:110866432816265798', 'tag:social.tchncs.de,2013:110841544306244640', 'tag:social.tchncs.de,2013:110836461808445886', 'tag:social.tchncs.de,2013:110808489536732556'])
I 2024-02-13 02:22:01.649857+00:00 Found 3 private activities: dict_keys(['tag:social.tchncs.de,2013:111642166977763546', 'tag:social.tchncs.de,2013:110960841596211836', 'tag:social.tchncs.de,2013:110831267660359679'])
D 2024-02-13 02:22:01.671057+00:00 discovering original posts for: https://social.tchncs.de/@suitbertmonz/111917800232119924
I 2024-02-13 02:22:01.671592+00:00 requests.head https://norden.social/@SheDrivesMobility {'headers': {}}
I 2024-02-13 02:22:02.249191+00:00 Received 200
I 2024-02-13 02:22:02.249626+00:00 Original post discovery found original posts set(), mentions {'https://norden.social/@SheDrivesMobility'}
I 2024-02-13 02:22:02.250004+00:00 requests.head https://social.tchncs.de/@suitbertmonz/111917800232119924 {'headers': None}
I 2024-02-13 02:22:02.961390+00:00 Received 200
I 2024-02-13 02:22:02.962591+00:00 starting posse post discovery with syndicated https://social.tchncs.de/@suitbertmonz/111917800232119924
I 2024-02-13 02:22:03.006686+00:00 requests.head http://suitbertmonz.wordpress.com/ {'headers': {}}
I 2024-02-13 02:22:04.021817+00:00 Redirected to https://suitbertmonz.wordpress.com/
I 2024-02-13 02:22:04.022177+00:00 Received 410
W 2024-02-13 02:22:04.022321+00:00 Couldn't resolve URL http://suitbertmonz.wordpress.com/: https://suitbertmonz.wordpress.com/
D 2024-02-13 02:22:04.023574+00:00 fetching author url https://suitbertmonz.wordpress.com/
I 2024-02-13 02:22:04.023771+00:00 requests.get https://suitbertmonz.wordpress.com/ {'gateway': False, 'headers': {}}
I 2024-02-13 02:22:04.610647+00:00 Received 410
I 2024-02-13 02:22:04.611003+00:00 Could not fetch author url https://suitbertmonz.wordpress.com/
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 410 Client Error: Gone for url: https://suitbertmonz.wordpress.com/
I 2024-02-13 02:22:04.615897+00:00 requests.head https://suitbertmonz.de/ {'headers': {}}
I 2024-02-13 02:22:05.125415+00:00 Received 200
D 2024-02-13 02:22:05.126778+00:00 fetching author url https://suitbertmonz.de/
I 2024-02-13 02:22:05.127004+00:00 requests.get https://suitbertmonz.de/ {'gateway': False, 'headers': {}}
I 2024-02-13 02:22:05.427897+00:00 Received 200
I 2024-02-13 02:22:05.871105+00:00 Hit cap of 10 permalinks. Stopping.
D 2024-02-13 02:22:06.066782+00:00 processing permalink: https://suitbertmonz.de/2024/02/10/symbolfoto-der-morgen.html
D 2024-02-13 02:22:06.067096+00:00 processing permalink: https://suitbertmonz.de/2024/02/09/fastnacht-in-meenz.html
D 2024-02-13 02:22:06.067223+00:00 processing permalink: https://suitbertmonz.de/2024/02/04/hier-werden-deutschlands.html
D 2024-02-13 02:22:06.067335+00:00 processing permalink: https://suitbertmonz.de/2024/02/02/unser-abendspaziergang-um.html
D 2024-02-13 02:22:06.067447+00:00 processing permalink: https://suitbertmonz.de/2024/02/01/einen-schnen-feierabend.html
D 2024-02-13 02:22:06.067547+00:00 processing permalink: https://suitbertmonz.de/2024/01/29/heute-sind-es.html
D 2024-02-13 02:22:06.067643+00:00 processing permalink: https://suitbertmonz.de/2024/01/26/im-coronalockdown-entstanden.html
D 2024-02-13 02:22:06.067747+00:00 processing permalink: https://suitbertmonz.de/2024/01/21/noch-mal-einen.html
D 2024-02-13 02:22:06.067842+00:00 processing permalink: https://suitbertmonz.de/2024/01/19/heute-morgen-im.html
D 2024-02-13 02:22:06.067940+00:00 processing permalink: https://suitbertmonz.de/2024/01/18/rheinhessen-hier-schneit.html
D 2024-02-13 02:22:06.068113+00:00 posse post discovery found no relationship for https://social.tchncs.de/@suitbertmonz/111917800232119924
D 2024-02-13 02:22:06.375658+00:00 discovering original posts for: https://social.tchncs.de/@suitbertmonz/111903166324042503
I 2024-02-13 02:22:06.376685+00:00 requests.head https://social.tchncs.de/tags/helau {'headers': {}}
I 2024-02-13 02:22:07.051466+00:00 Received 200
I 2024-02-13 02:22:07.052038+00:00 Original post discovery found original posts set(), mentions {'https://social.tchncs.de/tags/helau'}
I 2024-02-13 02:22:07.056412+00:00 requests.head https://social.tchncs.de/@suitbertmonz/111903166324042503 {'headers': None}
I 2024-02-13 02:22:07.751578+00:00 Received 200
I 2024-02-13 02:22:07.751901+00:00 starting posse post discovery with syndicated https://social.tchncs.de/@suitbertmonz/111903166324042503
I 2024-02-13 02:22:07.984451+00:00 refetching h-feed for source @suitbertmonz@social.tchncs.de (Mastodon)
D 2024-02-13 02:22:07.984706+00:00 attempting to refetch h-feed for @suitbertmonz@social.tchncs.de (Mastodon)
D 2024-02-13 02:22:07.985959+00:00 fetching author url https://suitbertmonz.wordpress.com/
I 2024-02-13 02:22:07.986134+00:00 requests.get https://suitbertmonz.wordpress.com/ {'gateway': False, 'headers': {}}
I 2024-02-13 02:22:08.685903+00:00 Received 410
I 2024-02-13 02:22:08.686211+00:00 Could not fetch author url https://suitbertmonz.wordpress.com/
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 410 Client Error: Gone for url: https://suitbertmonz.wordpress.com/
D 2024-02-13 02:22:08.689642+00:00 fetching author url https://suitbertmonz.de/
I 2024-02-13 02:22:08.689930+00:00 requests.get https://suitbertmonz.de/ {'gateway': False, 'headers': {}}
I 2024-02-13 02:22:09.011709+00:00 Received 200
I 2024-02-13 02:22:09.461226+00:00 Hit cap of 10 permalinks. Stopping.
D 2024-02-13 02:22:09.585088+00:00 processing permalink: https://suitbertmonz.de/2024/02/10/symbolfoto-der-morgen.html
I 2024-02-13 02:22:09.585531+00:00 requests.head https://suitbertmonz.de/2024/02/10/symbolfoto-der-morgen.html {'headers': {}}
I 2024-02-13 02:22:09.916207+00:00 Received 200
D 2024-02-13 02:22:09.917540+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kl2pimokgs2u'}
D 2024-02-13 02:22:09.917803+00:00 no syndication links from https://suitbertmonz.de/2024/02/10/symbolfoto-der-morgen.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:09.917929+00:00 processing permalink: https://suitbertmonz.de/2024/02/09/fastnacht-in-meenz.html
I 2024-02-13 02:22:09.918136+00:00 requests.head https://suitbertmonz.de/2024/02/09/fastnacht-in-meenz.html {'headers': {}}
I 2024-02-13 02:22:10.285307+00:00 Received 200
D 2024-02-13 02:22:10.286751+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kkyzotjuwj2g'}
D 2024-02-13 02:22:10.286990+00:00 no syndication links from https://suitbertmonz.de/2024/02/09/fastnacht-in-meenz.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:10.287105+00:00 processing permalink: https://suitbertmonz.de/2024/02/04/hier-werden-deutschlands.html
I 2024-02-13 02:22:10.287303+00:00 requests.head https://suitbertmonz.de/2024/02/04/hier-werden-deutschlands.html {'headers': {}}
I 2024-02-13 02:22:10.881281+00:00 Received 200
D 2024-02-13 02:22:10.949634+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kkljdi47hc2c'}
D 2024-02-13 02:22:10.950089+00:00 no syndication links from https://suitbertmonz.de/2024/02/04/hier-werden-deutschlands.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:10.950331+00:00 processing permalink: https://suitbertmonz.de/2024/02/02/unser-abendspaziergang-um.html
I 2024-02-13 02:22:10.950618+00:00 requests.head https://suitbertmonz.de/2024/02/02/unser-abendspaziergang-um.html {'headers': {}}
I 2024-02-13 02:22:11.383113+00:00 Received 200
D 2024-02-13 02:22:11.384862+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kkh5jnigx22n'}
D 2024-02-13 02:22:11.385147+00:00 no syndication links from https://suitbertmonz.de/2024/02/02/unser-abendspaziergang-um.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:11.385361+00:00 processing permalink: https://suitbertmonz.de/2024/02/01/einen-schnen-feierabend.html
I 2024-02-13 02:22:11.385848+00:00 requests.head https://suitbertmonz.de/2024/02/01/einen-schnen-feierabend.html {'headers': {}}
I 2024-02-13 02:22:11.685528+00:00 Received 200
D 2024-02-13 02:22:11.686878+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kkensulimm27'}
D 2024-02-13 02:22:11.687098+00:00 no syndication links from https://suitbertmonz.de/2024/02/01/einen-schnen-feierabend.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:11.687217+00:00 processing permalink: https://suitbertmonz.de/2024/01/29/heute-sind-es.html
I 2024-02-13 02:22:11.687415+00:00 requests.head https://suitbertmonz.de/2024/01/29/heute-sind-es.html {'headers': {}}
I 2024-02-13 02:22:12.382476+00:00 Received 200
D 2024-02-13 02:22:12.383822+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kk4xy2hql22b'}
D 2024-02-13 02:22:12.384071+00:00 no syndication links from https://suitbertmonz.de/2024/01/29/heute-sind-es.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:12.384191+00:00 processing permalink: https://suitbertmonz.de/2024/01/26/im-coronalockdown-entstanden.html
I 2024-02-13 02:22:12.384385+00:00 requests.head https://suitbertmonz.de/2024/01/26/im-coronalockdown-entstanden.html {'headers': {}}
I 2024-02-13 02:22:12.787439+00:00 Received 200
D 2024-02-13 02:22:12.788768+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kjvp23e7tj2j'}
D 2024-02-13 02:22:12.789009+00:00 no syndication links from https://suitbertmonz.de/2024/01/26/im-coronalockdown-entstanden.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:12.789125+00:00 processing permalink: https://suitbertmonz.de/2024/01/21/noch-mal-einen.html
I 2024-02-13 02:22:12.789312+00:00 requests.head https://suitbertmonz.de/2024/01/21/noch-mal-einen.html {'headers': {}}
I 2024-02-13 02:22:13.385859+00:00 Received 200
D 2024-02-13 02:22:13.455342+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kjiilkdqvo22'}
D 2024-02-13 02:22:13.456078+00:00 no syndication links from https://suitbertmonz.de/2024/01/21/noch-mal-einen.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:13.456235+00:00 processing permalink: https://suitbertmonz.de/2024/01/19/heute-morgen-im.html
I 2024-02-13 02:22:13.456568+00:00 requests.head https://suitbertmonz.de/2024/01/19/heute-morgen-im.html {'headers': {}}
I 2024-02-13 02:22:13.832081+00:00 Received 200
D 2024-02-13 02:22:13.833413+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kjd4rkld7m2m'}
D 2024-02-13 02:22:13.833632+00:00 no syndication links from https://suitbertmonz.de/2024/01/19/heute-morgen-im.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
D 2024-02-13 02:22:13.833748+00:00 processing permalink: https://suitbertmonz.de/2024/01/18/rheinhessen-hier-schneit.html
I 2024-02-13 02:22:13.834052+00:00 requests.head https://suitbertmonz.de/2024/01/18/rheinhessen-hier-schneit.html {'headers': {}}
I 2024-02-13 02:22:14.384211+00:00 Received 200
D 2024-02-13 02:22:14.450760+00:00 u-syndication links on the h-feed h-entry: {'at://did:plc:77gyaork5wkeoz3fpbelnozn/app.bsky.feed.post/3kjd4rs2jnf2i'}
D 2024-02-13 02:22:14.451089+00:00 no syndication links from https://suitbertmonz.de/2024/01/18/rheinhessen-hier-schneit.html to current source @suitbertmonz@social.tchncs.de (Mastodon).
I 2024-02-13 02:22:14.485794+00:00 Updating @suitbertmonz@social.tchncs.de (Mastodon) /mastodon/@suitbertmonz@social.tchncs.de : {'last_public_post': datetime.datetime(2024, 2, 12, 9, 28, 26, 80000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 13, 2, 21, 57, 27844, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_hfeed_refetch': datetime.datetime(2024, 2, 13, 2, 22, 14, 451541, tzinfo=datetime.timezone.utc)}
I 2024-02-13 02:22:14.767474+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/10271664136231107181 with ETA 1707878900: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ciwLEghNYXN0b2RvbiIeQHN1aXRiZXJ0bW9uekBzb2NpYWwudGNobmNzLmRlDA&last_polled=2024-02-13-02-21-57', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707878900
}