D 2024-02-16 05:21:52.009942+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-15-08-43-22')]
I 2024-02-16 05:21:52.029778+00:00 Source: dougbeal (GitHub) dougbeal, https://brid.gy/github/dougbeal
I 2024-02-16 05:21:52.030133+00:00 Last poll: https://brid.gy/log?start_time=1707986602&key=agdicmlkLWd5chQLEgZHaXRIdWIiCGRvdWdiZWFsDA
I 2024-02-16 05:21:52.053357+00:00 Updating dougbeal (GitHub) /github/dougbeal : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 16, 5, 21, 52, 30225, tzinfo=datetime.timezone.utc), 'rate_limited': False}
D 2024-02-16 05:21:52.148091+00:00 Using ETag Wed, 31 Jan 2024 21:53:56 GMT, last activity id travis-ci:travis.rb:578
I 2024-02-16 05:21:52.171446+00:00 no refresh_token
I 2024-02-16 05:21:52.171925+00:00 requests.get https://api.github.com/notifications?all=true&participating=true&per_page=10 {'headers': {'If-Modified-Since': '...', 'Authorization': '...'}}
I 2024-02-16 05:21:52.495897+00:00 Received 304 no Location header
I 2024-02-16 05:21:52.498675+00:00 Found 0 public activities: dict_keys([])
I 2024-02-16 05:21:52.498854+00:00 Found 0 private activities: dict_keys([])
I 2024-02-16 05:21:52.500710+00:00 refetching h-feed for source dougbeal (GitHub)
D 2024-02-16 05:21:52.500856+00:00 attempting to refetch h-feed for dougbeal (GitHub)
I 2024-02-16 05:21:52.501213+00:00 requests.head https://dougbeal.com/ {'headers': {}}
I 2024-02-16 05:21:52.968300+00:00 Received 200
D 2024-02-16 05:21:52.969586+00:00 fetching author url https://dougbeal.com/
I 2024-02-16 05:21:52.969818+00:00 requests.get https://dougbeal.com/ {'gateway': False, 'headers': {}}
I 2024-02-16 05:21:53.573583+00:00 Received 200
I 2024-02-16 05:21:53.936332+00:00 Hit cap of 10 permalinks. Stopping.
D 2024-02-16 05:21:54.038757+00:00 processing permalink: https://dougbeal.com/2022/02/06/alien-autopsy-memories-for-pen-addict-episode-600/
I 2024-02-16 05:21:54.039200+00:00 requests.head https://dougbeal.com/2022/02/06/alien-autopsy-memories-for-pen-addict-episode-600/ {'headers': {}}
I 2024-02-16 05:21:54.442855+00:00 Received 200
D 2024-02-16 05:21:54.443970+00:00 u-syndication links on the h-feed h-entry: {'https://brid.gy/publish/twitter'}
D 2024-02-16 05:21:54.444159+00:00 no syndication links from https://dougbeal.com/2022/02/06/alien-autopsy-memories-for-pen-addict-episode-600/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:54.444262+00:00 processing permalink: https://dougbeal.com/2020/02/23/7750/
I 2024-02-16 05:21:54.444414+00:00 requests.head https://dougbeal.com/2020/02/23/7750/ {'headers': {}}
I 2024-02-16 05:21:54.825511+00:00 Received 200
D 2024-02-16 05:21:54.826638+00:00 no syndication links from https://dougbeal.com/2020/02/23/7750/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:54.826747+00:00 processing permalink: https://dougbeal.com/2020/02/14/7744/
I 2024-02-16 05:21:54.826911+00:00 requests.head https://dougbeal.com/2020/02/14/7744/ {'headers': {}}
I 2024-02-16 05:21:55.180017+00:00 Received 200
D 2024-02-16 05:21:55.181043+00:00 u-syndication links on the h-feed h-entry: {'https://www.swarmapp.com/user/432794314/checkin/5e46d470cd67ff0008ac3829'}
D 2024-02-16 05:21:55.181215+00:00 no syndication links from https://dougbeal.com/2020/02/14/7744/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:55.181319+00:00 processing permalink: https://dougbeal.com/2019/11/27/7712/
I 2024-02-16 05:21:55.181468+00:00 requests.head https://dougbeal.com/2019/11/27/7712/ {'headers': {}}
I 2024-02-16 05:21:55.845157+00:00 Received 200
D 2024-02-16 05:21:55.846356+00:00 no syndication links from https://dougbeal.com/2019/11/27/7712/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:55.846470+00:00 processing permalink: https://dougbeal.com/2019/12/11/7736/
I 2024-02-16 05:21:55.846642+00:00 requests.head https://dougbeal.com/2019/12/11/7736/ {'headers': {}}
I 2024-02-16 05:21:56.471969+00:00 Received 200
D 2024-02-16 05:21:56.473195+00:00 u-syndication links on the h-feed h-entry: {'https://www.instagram.com/p/B59mHWRjAG5/', 'https://www.flickr.com/photos/gritmonkey/49207270801/', 'https://fed.brid.gy'}
D 2024-02-16 05:21:56.473478+00:00 no syndication links from https://dougbeal.com/2019/12/11/7736/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:56.473593+00:00 processing permalink: https://dougbeal.com/2019/12/11/spano-a-minimum-viable-micropub-media-endpoint/
I 2024-02-16 05:21:56.473765+00:00 requests.head https://dougbeal.com/2019/12/11/spano-a-minimum-viable-micropub-media-endpoint/ {'headers': {}}
I 2024-02-16 05:21:57.075667+00:00 Received 200
D 2024-02-16 05:21:57.076930+00:00 no syndication links from https://dougbeal.com/2019/12/11/spano-a-minimum-viable-micropub-media-endpoint/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:57.077051+00:00 processing permalink: https://dougbeal.com/2019/12/11/7731/
I 2024-02-16 05:21:57.077220+00:00 requests.head https://dougbeal.com/2019/12/11/7731/ {'headers': {}}
I 2024-02-16 05:21:57.636710+00:00 Received 200
D 2024-02-16 05:21:57.637975+00:00 u-syndication links on the h-feed h-entry: {'https://micro.blog/timswast/7170692'}
D 2024-02-16 05:21:57.638171+00:00 no syndication links from https://dougbeal.com/2019/12/11/7731/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:57.638286+00:00 processing permalink: https://dougbeal.com/2019/12/07/7730/
I 2024-02-16 05:21:57.638457+00:00 requests.head https://dougbeal.com/2019/12/07/7730/ {'headers': {}}
I 2024-02-16 05:21:58.053989+00:00 Received 200
D 2024-02-16 05:21:58.055382+00:00 no syndication links from https://dougbeal.com/2019/12/07/7730/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:58.055526+00:00 processing permalink: https://dougbeal.com/2019/12/06/7725/
I 2024-02-16 05:21:58.055736+00:00 requests.head https://dougbeal.com/2019/12/06/7725/ {'headers': {}}
I 2024-02-16 05:21:58.520670+00:00 Received 200
D 2024-02-16 05:21:58.521773+00:00 u-syndication links on the h-feed h-entry: {'https://twitter.com/murderofcrows/status/1203509263173337088'}
D 2024-02-16 05:21:58.521939+00:00 no syndication links from https://dougbeal.com/2019/12/06/7725/ to current source dougbeal (GitHub).
D 2024-02-16 05:21:58.522046+00:00 processing permalink: https://dougbeal.com/2019/12/07/7727/
I 2024-02-16 05:21:58.522197+00:00 requests.head https://dougbeal.com/2019/12/07/7727/ {'headers': {}}
I 2024-02-16 05:21:58.926494+00:00 Received 200
D 2024-02-16 05:21:58.927649+00:00 u-syndication links on the h-feed h-entry: {'https://twitter.com/murderofcrows/status/1203508733919350784'}
D 2024-02-16 05:21:58.927833+00:00 no syndication links from https://dougbeal.com/2019/12/07/7727/ to current source dougbeal (GitHub).
I 2024-02-16 05:21:58.928009+00:00 requests.head https://dougbeal.micro.blog/ {'headers': {}}
I 2024-02-16 05:22:00.166404+00:00 Redirected to https://micro.dougbeal.com/
I 2024-02-16 05:22:00.166678+00:00 Received 404
W 2024-02-16 05:22:00.166789+00:00 Couldn't resolve URL https://dougbeal.micro.blog/: https://micro.dougbeal.com/
D 2024-02-16 05:22:00.167775+00:00 fetching author url https://micro.dougbeal.com/
I 2024-02-16 05:22:00.167900+00:00 requests.get https://micro.dougbeal.com/ {'gateway': False, 'headers': {}}
I 2024-02-16 05:22:00.492026+00:00 Received 404
I 2024-02-16 05:22:00.492294+00:00 Could not fetch author url https://micro.dougbeal.com/
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2229, in fetch_mf2
resp.raise_for_status()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://micro.dougbeal.com/
I 2024-02-16 05:22:00.495418+00:00 requests.head https://micro.blog/dougbeal {'headers': {}}
I 2024-02-16 05:22:01.148422+00:00 Received 200
D 2024-02-16 05:22:01.151559+00:00 fetching author url https://micro.blog/dougbeal
I 2024-02-16 05:22:01.151818+00:00 requests.get https://micro.blog/dougbeal {'gateway': False, 'headers': {}}
I 2024-02-16 05:22:01.696054+00:00 Received 200
D 2024-02-16 05:22:01.702552+00:00 No h-feed found, fallback to top-level h-entrys.
I 2024-02-16 05:22:01.740754+00:00 Updating dougbeal (GitHub) /github/dougbeal : {'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 16, 5, 21, 52, 30225, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_hfeed_refetch': datetime.datetime(2024, 2, 16, 5, 22, 1, 702761, tzinfo=datetime.timezone.utc)}
I 2024-02-16 05:22:01.961575+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/0051325619435647978 with ETA 1708138804: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5chQLEgZHaXRIdWIiCGRvdWdiZWFsDA&last_polled=2024-02-16-05-21-52', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1708138804
}