D 2024-02-06 22:36:36.009380+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-05-17-54-53')]
I 2024-02-06 22:36:36.025397+00:00 Source: Paul Lindner (Flickr) 41894183934@N01, https://brid.gy/flickr/41894183934@N01
I 2024-02-06 22:36:36.025833+00:00 Last poll: https://brid.gy/log?start_time=1707155693&key=agdicmlkLWd5chsLEgZGbGlja3IiDzQxODk0MTgzOTM0QE4wMQw
I 2024-02-06 22:36:36.044352+00:00 Updating Paul Lindner (Flickr) /flickr/41894183934@N01 : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 6, 22, 36, 36, 25958, tzinfo=datetime.timezone.utc), 'rate_limited': False}
D 2024-02-06 22:36:36.117961+00:00 Using ETag None, last activity id 31675713263
I 2024-02-06 22:36:36.139209+00:00 no refresh_token
I 2024-02-06 22:36:36.140353+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.people.getPhotos&extras=date_upload%2Cdate_taken%2Cviews%2Cmedia%2Cdescription%2Ctags%2Cmachine_tags%2Cgeo%2Cpath_alias&per_page=10&user_id=me {}
I 2024-02-06 22:36:36.537300+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=31675713263 {}
I 2024-02-06 22:36:36.748277+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=31675713263 {}
I 2024-02-06 22:36:36.940230+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=29394303515 {}
I 2024-02-06 22:36:37.077335+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=29394303515 {}
I 2024-02-06 22:36:39.685438+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=29127221401 {}
I 2024-02-06 22:36:39.862953+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=29127221401 {}
I 2024-02-06 22:36:40.057368+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=28562238244 {}
I 2024-02-06 22:36:40.262276+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=28562238244 {}
I 2024-02-06 22:36:40.420653+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=28992488441 {}
I 2024-02-06 22:36:40.574241+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=28992488441 {}
I 2024-02-06 22:36:40.779854+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=29056902765 {}
I 2024-02-06 22:36:40.915539+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=29056902765 {}
I 2024-02-06 22:36:41.139841+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=908422757 {}
I 2024-02-06 22:36:42.381077+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=908422757 {}
I 2024-02-06 22:36:42.604244+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=908422747 {}
I 2024-02-06 22:36:42.742001+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=908422747 {}
I 2024-02-06 22:36:42.918874+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.comments.getList&photo_id=908422737 {}
I 2024-02-06 22:36:43.052456+00:00 urlopen GET https://api.flickr.com/services/rest?nojsoncallback=1&format=json&method=flickr.photos.getFavorites&photo_id=908422737 {}
I 2024-02-06 22:36:43.202201+00:00 Found 9 public activities: dict_keys(['tag:flickr.com,2013:31675713263', 'tag:flickr.com,2013:29394303515', 'tag:flickr.com,2013:29127221401', 'tag:flickr.com,2013:28562238244', 'tag:flickr.com,2013:28992488441', 'tag:flickr.com,2013:29056902765', 'tag:flickr.com,2013:908422757', 'tag:flickr.com,2013:908422747', 'tag:flickr.com,2013:908422737'])
I 2024-02-06 22:36:43.202482+00:00 Found 0 private activities: dict_keys([])
I 2024-02-06 22:36:43.202890+00:00 refetching h-feed for source Paul Lindner (Flickr)
D 2024-02-06 22:36:43.203040+00:00 attempting to refetch h-feed for Paul Lindner (Flickr)
I 2024-02-06 22:36:43.203299+00:00 requests.head http://www.1500wordmtu.com/ {'headers': {}}
I 2024-02-06 22:36:44.196463+00:00 Redirected to https://1500wordmtu.com/
I 2024-02-06 22:36:44.197002+00:00 Received 200
D 2024-02-06 22:36:44.197408+00:00 Resolved http://www.1500wordmtu.com/ to https://1500wordmtu.com/
D 2024-02-06 22:36:44.198751+00:00 fetching author url https://1500wordmtu.com/
I 2024-02-06 22:36:44.198907+00:00 requests.get https://1500wordmtu.com/ {'gateway': False, 'headers': {}}
I 2024-02-06 22:36:44.986013+00:00 Received 200
I 2024-02-06 22:36:45.572734+00:00 requests.head https://1500wordmtu.com/?_t=rss {'headers': {}}
I 2024-02-06 22:36:46.432326+00:00 Received 200
D 2024-02-06 22:36:46.433176+00:00 skipping feed since it's not HTML or otherwise bad
I 2024-02-06 22:36:46.433374+00:00 requests.head https://1500wordmtu.com/content/all?_t=rss {'headers': {}}
W 2024-02-06 22:37:01.437450+00:00 Couldn't resolve URL https://1500wordmtu.com/content/all?_t=rss : HTTPSConnectionPool(host='1500wordmtu.com', port=443): Max retries exceeded with url: /content/all?_t=rss (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e5a54e740d0>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)'))
W 2024-02-06 22:37:01.437777+00:00 Couldn't resolve URL https://1500wordmtu.com/content/all?_t=rss: https://1500wordmtu.com/content/all?_t=rss
I 2024-02-06 22:37:01.463032+00:00 requests.head https://1500wordmtu.com/content/all {'headers': {}}
I 2024-02-06 22:37:03.141372+00:00 Received 500
W 2024-02-06 22:37:03.142215+00:00 Couldn't resolve URL https://1500wordmtu.com/content/all: https://1500wordmtu.com/content/all
D 2024-02-06 22:37:03.143308+00:00 fetching author's rel-feed https://1500wordmtu.com/content/all?_t=rss
I 2024-02-06 22:37:03.143494+00:00 requests.get https://1500wordmtu.com/content/all?_t=rss {'gateway': False, 'headers': {}}
I 2024-02-06 22:37:03.767597+00:00 Received 500
I 2024-02-06 22:37:03.768029+00:00 Could not fetch h-feed url https://1500wordmtu.com/content/all?_t=rss.
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 333, in _process_author
feed_mf2 = util.fetch_mf2(feed_url)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://1500wordmtu.com/content/all?_t=rss
D 2024-02-06 22:37:03.780767+00:00 fetching author's rel-feed https://1500wordmtu.com/content/all
I 2024-02-06 22:37:03.781423+00:00 requests.get https://1500wordmtu.com/content/all {'gateway': False, 'headers': {}}
I 2024-02-06 22:37:18.785192+00:00 Could not fetch h-feed url https://1500wordmtu.com/content/all.
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: timed out
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x3e5a575cff50>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='1500wordmtu.com', port=443): Max retries exceeded with url: /content/all (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e5a575cff50>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 333, in _process_author
feed_mf2 = util.fetch_mf2(feed_url)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2228, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1667, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 507, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='1500wordmtu.com', port=443): Max retries exceeded with url: /content/all (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e5a575cff50>, 'Connection to 1500wordmtu.com timed out. (connect timeout=15)'))
I 2024-02-06 22:37:18.788700+00:00 Hit cap of 10 permalinks. Stopping.
D 2024-02-06 22:37:18.876887+00:00 processing permalink: https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit
I 2024-02-06 22:37:18.877260+00:00 requests.head https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit {'headers': {}}
I 2024-02-06 22:37:20.390143+00:00 Received 200
D 2024-02-06 22:37:20.391385+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111455137767238243'}
D 2024-02-06 22:37:20.391665+00:00 no syndication links from https://1500wordmtu.com/2023/lol-with-my-5th-dose-i-hit to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:20.391780+00:00 processing permalink: https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023
I 2024-02-06 22:37:20.391939+00:00 requests.head https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023 {'headers': {}}
I 2024-02-06 22:37:20.771497+00:00 Received 200
D 2024-02-06 22:37:20.772673+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111264822185632653'}
D 2024-02-06 22:37:20.772899+00:00 no syndication links from https://1500wordmtu.com/2023/rubber-chickens-and-fun-times-at-how-weird-festival-2023 to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:20.773005+00:00 processing permalink: https://1500wordmtu.com/2023/janine-gus-audrey-and-me
I 2024-02-06 22:37:20.773156+00:00 requests.head https://1500wordmtu.com/2023/janine-gus-audrey-and-me {'headers': {}}
I 2024-02-06 22:37:22.073903+00:00 Received 200
D 2024-02-06 22:37:22.074951+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/111264815163166883'}
D 2024-02-06 22:37:22.075181+00:00 no syndication links from https://1500wordmtu.com/2023/janine-gus-audrey-and-me to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:22.075277+00:00 processing permalink: https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023
I 2024-02-06 22:37:22.075431+00:00 requests.head https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023 {'headers': {}}
I 2024-02-06 22:37:22.479969+00:00 Received 200
D 2024-02-06 22:37:22.481109+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110878417024064564'}
D 2024-02-06 22:37:22.481364+00:00 no syndication links from https://1500wordmtu.com/2023/married-my-love-janine-august-5th-2023 to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:22.481476+00:00 processing permalink: https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman
I 2024-02-06 22:37:22.481638+00:00 requests.head https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman {'headers': {}}
I 2024-02-06 22:37:23.837006+00:00 Received 200
D 2024-02-06 22:37:23.838467+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110556334962329309'}
D 2024-02-06 22:37:23.838829+00:00 no syndication links from https://1500wordmtu.com/2023/achivement-unlocked-got-mistaken-for-danny-elfman to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:23.838958+00:00 processing permalink: https://1500wordmtu.com/2023/neotropolis-2023
I 2024-02-06 22:37:23.839208+00:00 requests.head https://1500wordmtu.com/2023/neotropolis-2023 {'headers': {}}
I 2024-02-06 22:37:24.204715+00:00 Received 200
D 2024-02-06 22:37:24.205842+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110380391408791040'}
D 2024-02-06 22:37:24.206079+00:00 no syndication links from https://1500wordmtu.com/2023/neotropolis-2023 to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:24.206181+00:00 processing permalink: https://1500wordmtu.com/2023/leaving-montclair
I 2024-02-06 22:37:24.206333+00:00 requests.head https://1500wordmtu.com/2023/leaving-montclair {'headers': {}}
I 2024-02-06 22:37:24.814783+00:00 Received 200
D 2024-02-06 22:37:24.816258+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110318117006028146'}
D 2024-02-06 22:37:24.816504+00:00 no syndication links from https://1500wordmtu.com/2023/leaving-montclair to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:24.816607+00:00 processing permalink: https://1500wordmtu.com/2023/thanks-for-supporting-bridgy-all-these-years
I 2024-02-06 22:37:24.816779+00:00 requests.head https://1500wordmtu.com/2023/thanks-for-supporting-bridgy-all-these-years {'headers': {}}
I 2024-02-06 22:37:25.198987+00:00 Received 200
D 2024-02-06 22:37:25.200543+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/110193474861139294'}
D 2024-02-06 22:37:25.200803+00:00 no syndication links from https://1500wordmtu.com/2023/thanks-for-supporting-bridgy-all-these-years to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:25.200904+00:00 processing permalink: https://1500wordmtu.com/2023/fools-gold
I 2024-02-06 22:37:25.201239+00:00 requests.head https://1500wordmtu.com/2023/fools-gold {'headers': {}}
I 2024-02-06 22:37:25.665092+00:00 Received 200
D 2024-02-06 22:37:25.666556+00:00 no syndication links from https://1500wordmtu.com/2023/fools-gold to current source Paul Lindner (Flickr).
D 2024-02-06 22:37:25.666679+00:00 processing permalink: https://1500wordmtu.com/2023/transformations
I 2024-02-06 22:37:25.666865+00:00 requests.head https://1500wordmtu.com/2023/transformations {'headers': {}}
I 2024-02-06 22:37:32.790165+00:00 Received 200
D 2024-02-06 22:37:32.791404+00:00 u-syndication links on the h-feed h-entry: {'https://social.coop/@lindner/109955170607327066', 'https://twitter.com/lindner/status/1631365238653341696'}
D 2024-02-06 22:37:32.791701+00:00 no syndication links from https://1500wordmtu.com/2023/transformations to current source Paul Lindner (Flickr).
I 2024-02-06 22:37:32.808664+00:00 Updating Paul Lindner (Flickr) /flickr/41894183934@N01 : {'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 6, 22, 36, 36, 25958, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_hfeed_refetch': datetime.datetime(2024, 2, 6, 22, 37, 32, 792206, tzinfo=datetime.timezone.utc)}
I 2024-02-06 22:37:32.909934+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/6740417456039663344 with ETA 1707340684: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5chsLEgZGbGlja3IiDzQxODk0MTgzOTM0QE4wMQw&last_polled=2024-02-06-22-36-36', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707340684
}