D 2024-02-08 00:04:14.008909+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-07-00-31-28')]
I 2024-02-08 00:04:14.047635+00:00 Source: @lindner@social.coop (Mastodon) @lindner@social.coop, https://brid.gy/mastodon/@lindner@social.coop
I 2024-02-08 00:04:14.048040+00:00 Last poll: https://brid.gy/log?start_time=1707265888&key=agdicmlkLWd5ciILEghNYXN0b2RvbiIUQGxpbmRuZXJAc29jaWFsLmNvb3AM
I 2024-02-08 00:04:14.075471+00:00 Updating @lindner@social.coop (Mastodon) /mastodon/@lindner@social.coop : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 8, 0, 4, 14, 48134, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-08 00:04:14.159441+00:00 no refresh_token
I 2024-02-08 00:04:14.185154+00:00 requests.get https://social.coop/api/v1/accounts/38434/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-08 00:04:15.155829+00:00 Redirected to https://social.coop/api/v1/accounts/38434/statuses?limit=30
I 2024-02-08 00:04:15.281953+00:00 Received 200
I 2024-02-08 00:04:15.372836+00:00 requests.get https://social.coop/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-08 00:04:16.579551+00:00 Redirected to https://social.coop/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-08 00:04:16.712390+00:00 Received 200
I 2024-02-08 00:04:16.795111+00:00 Found 62 public activities: dict_keys(['tag:social.coop,2013:111455137767238243', 'tag:social.coop,2013:111264822185632653', 'tag:social.coop,2013:111264815163166883', 'tag:social.coop,2013:110878417024064564', 'tag:social.coop,2013:110556334962329309', 'tag:social.coop,2013:110380391408791040', 'tag:social.coop,2013:110318117006028146', 'tag:social.coop,2013:110318112140734702', 'tag:social.coop,2013:110193474861139294', 'tag:social.coop,2013:109955170607327066', 'tag:social.coop,2013:109921238918756646', 'tag:social.coop,2013:109660762743798223', 'tag:social.coop,2013:109636181720471241', 'tag:social.coop,2013:109628796886436142', 'tag:social.coop,2013:109626602093052911', 'tag:social.coop,2013:109587886729576338', 'tag:social.coop,2013:109503869830812127', 'tag:social.coop,2013:109429326469178277', 'tag:social.coop,2013:109373561878098519', 'tag:social.coop,2013:109371254280392877', 'tag:social.coop,2013:109362509999183863', 'tag:social.coop,2013:109116277814788181', 'tag:social.coop,2013:109110745341628963', 'tag:social.coop,2013:109073337241223370', 'tag:social.coop,2013:109073168980091233', 'tag:social.coop,2013:109067037874787056', 'tag:social.coop,2013:109054608129873941', 'tag:social.coop,2013:109054598002875559', 'tag:social.coop,2013:109054586880903999', 'tag:social.coop,2013:109054579463081025', 'tag:social.coop,2013:110878471171387662', 'tag:social.coop,2013:109955175043551136', 'tag:social.coop,2013:109660862484919430', 'tag:social.coop,2013:109433303278041518', 'tag:social.coop,2013:109428708074335762', 'tag:social.coop,2013:109427473428393380', 'tag:social.coop,2013:109425017738307916', 'tag:social.coop,2013:109005338662043984', 'tag:social.coop,2013:108210838446991857', 'tag:social.coop,2013:108210822094750884', 'tag:social.coop,2013:108210816119929304', 'tag:social.coop,2013:108210807645079829', 'tag:social.coop,2013:106648586544759606', 'tag:social.coop,2013:106099994421958105', 'tag:social.coop,2013:105263693872906038', 'tag:social.coop,2013:103983424310238677', 'tag:social.coop,2013:103824281194231556', 'tag:social.coop,2013:103824180386520022', 'tag:social.coop,2013:103824173487481572', 'tag:social.coop,2013:103794201116144823', 'tag:social.coop,2013:103793997487358495', 'tag:social.coop,2013:103793996967864625', 'tag:social.coop,2013:103793989805652237', 'tag:social.coop,2013:103751457746952520', 'tag:social.coop,2013:103695285252650380', 'tag:social.coop,2013:103479966712204240', 'tag:social.coop,2013:103478626786132364', 'tag:social.coop,2013:101547250598329542', 'tag:social.coop,2013:101547246609171589', 'tag:social.coop,2013:101394474281504275', 'tag:social.coop,2013:101010935176631256', 'tag:social.coop,2013:101010725911903513'])
I 2024-02-08 00:04:16.795547+00:00 Found 8 private activities: dict_keys(['tag:social.coop,2013:111269155491411678', 'tag:social.coop,2013:109357546461821994', 'tag:social.coop,2013:108874804661970808', 'tag:social.coop,2013:104856361347178759', 'tag:social.coop,2013:104337438285274845', 'tag:social.coop,2013:102458587869355766', 'tag:social.coop,2013:102225967505256923', 'tag:social.coop,2013:101090842995094151'])
I 2024-02-08 00:04:16.866637+00:00 refetching h-feed for source @lindner@social.coop (Mastodon)
D 2024-02-08 00:04:16.866966+00:00 attempting to refetch h-feed for @lindner@social.coop (Mastodon)
I 2024-02-08 00:04:16.867237+00:00 requests.head https://1500wordmtu.com/ {'headers': {}}
I 2024-02-08 00:04:17.638410+00:00 Received 200
D 2024-02-08 00:04:17.639573+00:00 fetching author url https://1500wordmtu.com/
I 2024-02-08 00:04:17.639738+00:00 requests.get https://1500wordmtu.com/ {'gateway': False, 'headers': {}}
I 2024-02-08 00:04:19.897170+00:00 Received 200
I 2024-02-08 00:04:20.477632+00:00 requests.head https://1500wordmtu.com/?_t=rss {'headers': {}}
I 2024-02-08 00:04:22.252922+00:00 Received 200
D 2024-02-08 00:04:22.253775+00:00 skipping feed since it's not HTML or otherwise bad
I 2024-02-08 00:04:22.253958+00:00 requests.head https://1500wordmtu.com/content/all?_t=rss {'headers': {}}
I 2024-02-08 00:04:25.739520+00:00 Received 500
W 2024-02-08 00:04:25.740206+00:00 Couldn't resolve URL https://1500wordmtu.com/content/all?_t=rss: https://1500wordmtu.com/content/all?_t=rss
I 2024-02-08 00:04:25.741414+00:00 requests.head https://1500wordmtu.com/content/all {'headers': {}}
I 2024-02-08 00:04:26.243811+00:00 Received 500
W 2024-02-08 00:04:26.244777+00:00 Couldn't resolve URL https://1500wordmtu.com/content/all: https://1500wordmtu.com/content/all
D 2024-02-08 00:04:26.245880+00:00 fetching author's rel-feed https://1500wordmtu.com/content/all?_t=rss
I 2024-02-08 00:04:26.246078+00:00 requests.get https://1500wordmtu.com/content/all?_t=rss {'gateway': False, 'headers': {}}
I 2024-02-08 00:04:41.250916+00:00 Could not fetch h-feed url https://1500wordmtu.com/content/all?_t=rss.
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: timed out
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x3e7f17ffa850>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='1500wordmtu.com', port=443): Max retries exceeded with url: /content/all?_t=rss (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e7f17ffa850>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 333, in _process_author
feed_mf2 = util.fetch_mf2(feed_url)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2228, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1667, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 507, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='1500wordmtu.com', port=443): Max retries exceeded with url: /content/all?_t=rss (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e7f17ffa850>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)'))
D 2024-02-08 00:04:41.254252+00:00 fetching author's rel-feed https://1500wordmtu.com/content/all
I 2024-02-08 00:04:41.254523+00:00 requests.get https://1500wordmtu.com/content/all {'gateway': False, 'headers': {}}
I 2024-02-08 00:04:41.758801+00:00 Received 500
I 2024-02-08 00:04:41.759085+00:00 Could not fetch h-feed url https://1500wordmtu.com/content/all.
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 333, in _process_author
feed_mf2 = util.fetch_mf2(feed_url)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://1500wordmtu.com/content/all
I 2024-02-08 00:04:41.764836+00:00 Hit cap of 10 permalinks. Stopping.
D 2024-02-08 00:04:41.881293+00:00 processing permalink: https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit
D 2024-02-08 00:04:41.881621+00:00 previously found relationship(s) for original https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit: ['https://social.coop/@lindner/111455137767238243']
I 2024-02-08 00:04:41.881925+00:00 requests.head https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit {'headers': {}}
I 2024-02-08 00:04:44.626651+00:00 Received 200
D 2024-02-08 00:04:44.627865+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111455137767238243'}
I 2024-02-08 00:04:44.628050+00:00 requests.head https://social.coop/@lindner/111455137767238243 {'headers': None}
I 2024-02-08 00:04:45.285641+00:00 Received 200
D 2024-02-08 00:04:45.286151+00:00 processing permalink: https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023
D 2024-02-08 00:04:45.286348+00:00 previously found relationship(s) for original https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023: ['https://social.coop/@lindner/111264822185632653']
I 2024-02-08 00:04:45.286572+00:00 requests.head https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023 {'headers': {}}
I 2024-02-08 00:04:52.698630+00:00 Received 200
D 2024-02-08 00:04:52.699953+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111264822185632653'}
I 2024-02-08 00:04:52.700329+00:00 requests.head https://social.coop/@lindner/111264822185632653 {'headers': None}
I 2024-02-08 00:04:53.322298+00:00 Received 200
D 2024-02-08 00:04:53.322800+00:00 processing permalink: https://1500wordmtu.com/2023/janine-gus-audrey-and-me
D 2024-02-08 00:04:53.322995+00:00 previously found relationship(s) for original https://1500wordmtu.com/2023/janine-gus-audrey-and-me: ['https://social.coop/@lindner/111264815163166883']
I 2024-02-08 00:04:53.323249+00:00 requests.head https://1500wordmtu.com/2023/janine-gus-audrey-and-me {'headers': {}}
I 2024-02-08 00:04:56.762784+00:00 Received 200
D 2024-02-08 00:04:56.765366+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111264815163166883'}
I 2024-02-08 00:04:56.765568+00:00 requests.head https://social.coop/@lindner/111264815163166883 {'headers': None}
I 2024-02-08 00:04:57.745805+00:00 Received 200
D 2024-02-08 00:04:57.768639+00:00 processing permalink: https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023
D 2024-02-08 00:04:57.769938+00:00 previously found relationship(s) for original https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023: ['https://social.coop/@lindner/110878417024064564']
I 2024-02-08 00:04:57.771780+00:00 requests.head https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023 {'headers': {}}
I 2024-02-08 00:05:00.267705+00:00 Received 200
D 2024-02-08 00:05:00.286819+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110878417024064564'}
I 2024-02-08 00:05:00.287620+00:00 requests.head https://social.coop/@lindner/110878417024064564 {'headers': None}
I 2024-02-08 00:05:02.986685+00:00 Received 200
D 2024-02-08 00:05:02.987128+00:00 processing permalink: https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman
D 2024-02-08 00:05:02.987263+00:00 previously found relationship(s) for original https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman: ['https://social.coop/@lindner/110556334962329309']
I 2024-02-08 00:05:02.987453+00:00 requests.head https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman {'headers': {}}