D 2024-02-01 21:35:26.027498+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-01-20-59-42')]
I 2024-02-01 21:35:26.061690+00:00 Source: @cory@social.lol (Mastodon) @cory@social.lol, https://brid.gy/mastodon/@cory@social.lol
I 2024-02-01 21:35:26.062093+00:00 Last poll: https://brid.gy/log?start_time=1706821182&key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw
I 2024-02-01 21:35:26.085892+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 1, 21, 35, 26, 62211, tzinfo=datetime.timezone.utc), 'rate_limited': False}
I 2024-02-01 21:35:26.205422+00:00 no refresh_token
I 2024-02-01 21:35:26.229416+00:00 requests.get https://social.lol/api/v1/accounts/109606224363698309/statuses {'params': {'limit': 30}, 'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:27.102455+00:00 Redirected to https://social.lol/api/v1/accounts/109606224363698309/statuses?limit=30
I 2024-02-01 21:35:27.108575+00:00 Received 200
I 2024-02-01 21:35:27.121792+00:00 requests.get https://social.lol/api/v1/statuses/111858334607604782/context {'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:27.558388+00:00 Received 200
I 2024-02-01 21:35:27.605824+00:00 requests.get https://social.lol/api/v1/statuses/111857960582461877/context {'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:28.085758+00:00 Received 200
I 2024-02-01 21:35:28.119258+00:00 requests.get https://social.lol/api/v1/statuses/111857960582461877/reblogged_by {'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:28.572191+00:00 Received 200
I 2024-02-01 21:35:28.609449+00:00 requests.get https://social.lol/api/v1/notifications {'params': {'exclude_types[]': ['follow', 'favourite', 'reblog']}, 'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:29.576810+00:00 Redirected to https://social.lol/api/v1/notifications?exclude_types%5B%5D=follow&exclude_types%5B%5D=favourite&exclude_types%5B%5D=reblog
I 2024-02-01 21:35:29.582610+00:00 Received 200
I 2024-02-01 21:35:29.721064+00:00 Found 62 public activities: dict_keys(['tag:social.lol,2013:111858360265430541', 'tag:social.lol,2013:111858334607604782', 'tag:social.lol,2013:111858295881866214', 'tag:social.lol,2013:111858292590925423', 'tag:social.lol,2013:111858232913658162', 'tag:social.lol,2013:111858223313012481', 'tag:social.lol,2013:111858145769394549', 'tag:social.lol,2013:111858143144508694', 'tag:social.lol,2013:111858124895326493', 'tag:social.lol,2013:111858124808185188', 'tag:social.lol,2013:111858117039615465', 'tag:social.lol,2013:111858087340181873', 'tag:social.lol,2013:111858084195594544', 'tag:social.lol,2013:111858078846853190', 'tag:social.lol,2013:111858075231432350', 'tag:social.lol,2013:111858071592149650', 'tag:social.lol,2013:111858064076649503', 'tag:social.lol,2013:111858045144076167', 'tag:social.lol,2013:111858045129651678', 'tag:social.lol,2013:111858012900385063', 'tag:social.lol,2013:111857976699192645', 'tag:social.lol,2013:111857976000643170', 'tag:social.lol,2013:111857974496042589', 'tag:social.lol,2013:111857960582461877', 'tag:social.lol,2013:111857958193108054', 'tag:social.lol,2013:111857839576982534', 'tag:social.lol,2013:111857839523196325', 'tag:social.lol,2013:111857839438820513', 'tag:social.lol,2013:111857839372860920', 'tag:social.lol,2013:111857832390617920', 'tag:social.lol,2013:111858355945227277', 'tag:social.lol,2013:111858331277984338', 'tag:social.lol,2013:111858229642421605', 'tag:social.lol,2013:111858220928458544', 'tag:social.lol,2013:111858142375910588', 'tag:social.lol,2013:111858123180578543', 'tag:social.lol,2013:111858108908075898', 'tag:social.lol,2013:111858081597111758', 'tag:social.lol,2013:111858076583502100', 'tag:social.lol,2013:111858074112411182', 'tag:social.lol,2013:111858067481198358', 'tag:social.lol,2013:111858057776982861', 'tag:social.lol,2013:111858040925799918', 'tag:social.lol,2013:111856592125374009', 'tag:social.lol,2013:111855905984129938', 'tag:social.lol,2013:111853072964429714', 'tag:social.lol,2013:111855114405122381', 'tag:social.lol,2013:111853080696692756', 'tag:social.lol,2013:111852989090171769', 'tag:social.lol,2013:111852200358488069', 'tag:social.lol,2013:111852145436594412', 'tag:social.lol,2013:111852135499156628', 'tag:social.lol,2013:111852127901810645', 'tag:social.lol,2013:111852108501192697', 'tag:social.lol,2013:111851982676545761', 'tag:social.lol,2013:111851313159664929', 'tag:social.lol,2013:111851256521673367', 'tag:social.lol,2013:111847705099666875', 'tag:social.lol,2013:111847222049670525', 'tag:social.lol,2013:111847170352996730', 'tag:social.lol,2013:111847154583201519', 'tag:social.lol,2013:111847107762386815'])
I 2024-02-01 21:35:29.721337+00:00 Found 3 private activities: dict_keys(['tag:social.lol,2013:111852792516964453', 'tag:social.lol,2013:111852787192327581', 'tag:social.lol,2013:111851195365641339'])
I 2024-02-01 21:35:29.796776+00:00 Skipping blocked/opt out user: {
"objectType": "person",
"id": "tag:social.lol,2013:nfd",
"numeric_id": "111434480995090789",
"username": "nfd",
"displayName": "Nathaniel Daught :prami:",
"url": "https://social.lol/@nfd",
"urls": [
{
"value": "https://social.lol/@nfd"
},
{
"value": "https://daught.me"
},
{
"value": "https://glass.photo/nathaniel"
},
{
"value": "https://nfd.omg.lol"
},
{
"value": "https://masto.ai/@nfd"
}
],
"image": {
"url": "https://media.social.lol/accounts/avatars/111/434/480/995/090/789/original/0eed8403dbe298bb.png"
},
"published": "2023-11-19T00:00:00.000Z",
"description": "<p>(he/they) Queer nerdy creative who does visual & product design for a living. Oakland, CA \ud83c\udff3\ufe0f\u200d\ud83c\udf08</p><p><a href=\"https://social.lol/tags/oakland\" class=\"mention hashtag\" rel=\"tag\">#<span>oakland</span></a> <a href=\"https://social.lol/tags/california\" class=\"mention hashtag\" rel=\"tag\">#<span>california</span></a> <a href=\"https://social.lol/tags/design\" class=\"mention hashtag\" rel=\"tag\">#<span>design</span></a> <a href=\"https://social.lol/tags/apple\" class=\"mention hashtag\" rel=\"tag\">#<span>apple</span></a> <a href=\"https://social.lol/tags/gaming\" class=\"mention hashtag\" rel=\"tag\">#<span>gaming</span></a> <a href=\"https://social.lol/tags/scifi\" class=\"mention hashtag\" rel=\"tag\">#<span>scifi</span></a> <a href=\"https://social.lol/tags/StarTrek\" class=\"mention hashtag\" rel=\"tag\">#<span>StarTrek</span></a> <a href=\"https://social.lol/tags/TheExpanse\" class=\"mention hashtag\" rel=\"tag\">#<span>TheExpanse</span></a> <a href=\"https://social.lol/tags/art\" class=\"mention hashtag\" rel=\"tag\">#<span>art</span></a> <a href=\"https://social.lol/tags/photography\" class=\"mention hashtag\" rel=\"tag\">#<span>photography</span></a> <a href=\"https://social.lol/tags/coffee\" class=\"mention hashtag\" rel=\"tag\">#<span>coffee</span></a> <a href=\"https://social.lol/tags/CraftBeer\" class=\"mention hashtag\" rel=\"tag\">#<span>CraftBeer</span></a> <a href=\"https://social.lol/tags/wine\" class=\"mention hashtag\" rel=\"tag\">#<span>wine</span></a> <a href=\"https://social.lol/tags/plants\" class=\"mention hashtag\" rel=\"tag\">#<span>plants</span></a> <a href=\"https://social.lol/tags/HousePlants\" class=\"mention hashtag\" rel=\"tag\">#<span>HousePlants</span></a> <a href=\"https://social.lol/tags/headphones\" class=\"mention hashtag\" rel=\"tag\">#<span>headphones</span></a> <a href=\"https://social.lol/tags/DigitalRights\" class=\"mention hashtag\" rel=\"tag\">#<span>DigitalRights</span></a> <a href=\"https://social.lol/tags/EFF\" class=\"mention hashtag\" rel=\"tag\">#<span>EFF</span></a> <a href=\"https://social.lol/tags/privacy\" class=\"mention hashtag\" rel=\"tag\">#<span>privacy</span></a> <a href=\"https://social.lol/tags/nobot\" class=\"mention hashtag\" rel=\"tag\">#<span>nobot</span></a> <a href=\"https://social.lol/tags/fedi22\" class=\"mention hashtag\" rel=\"tag\">#<span>fedi22</span></a></p><p>Started poking around Mastodon in 2017: <a href=\"https://mastodon.social/@ndaught\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" translate=\"no\"><span class=\"invisible\">https://</span><span class=\"\">mastodon.social/@ndaught</span><span class=\"invisible\"></span></a> > <a href=\"https://masto.ai/@nfd\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" translate=\"no\"><span class=\"invisible\">https://</span><span class=\"\">masto.ai/@nfd</span><span class=\"invisible\"></span></a> > :prami: social.lol \u2014 Formerly @ndaught on the bad websites.</p><p>\u2705 <a href=\"https://proven.lol/be533f\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" translate=\"no\"><span class=\"invisible\">https://</span><span class=\"\">proven.lol/be533f</span><span class=\"invisible\"></span></a></p>"
}
D 2024-02-01 21:35:29.800637+00:00 discovering original posts for: https://social.lol/@cory/111857960582461877
I 2024-02-01 21:35:29.800968+00:00 Original post discovery found original posts set(), mentions set()
I 2024-02-01 21:35:29.801713+00:00 requests.head https://social.lol/@cory/111857960582461877 {'headers': None}
I 2024-02-01 21:35:30.186146+00:00 Received 200
I 2024-02-01 21:35:30.186513+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111857960582461877
D 2024-02-01 21:35:30.228266+00:00 discovering original posts for: https://social.lol/@cory/111858334607604782
I 2024-02-01 21:35:30.228912+00:00 requests.head https://darkvisitors.com/ {'headers': {}}
I 2024-02-01 21:35:31.362809+00:00 Received 200
I 2024-02-01 21:35:31.363237+00:00 requests.head https://social.lol/@andyn {'headers': {'User-Agent': '...'}}
I 2024-02-01 21:35:31.906494+00:00 Received 200
I 2024-02-01 21:35:31.906916+00:00 Original post discovery found original posts set(), mentions {'https://darkvisitors.com/', 'https://social.lol/@andyn'}
I 2024-02-01 21:35:31.908214+00:00 requests.head https://social.lol/@cory/111858334607604782 {'headers': None}
I 2024-02-01 21:35:32.179056+00:00 Received 200
I 2024-02-01 21:35:32.179392+00:00 starting posse post discovery with syndicated https://social.lol/@cory/111858334607604782
I 2024-02-01 21:35:32.214460+00:00 requests.head https://coryd.dev/ {'headers': {}}
I 2024-02-01 21:35:32.649714+00:00 Received 200
D 2024-02-01 21:35:32.651402+00:00 fetching author url https://coryd.dev/
I 2024-02-01 21:35:32.651692+00:00 requests.get https://coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-01 21:35:32.875740+00:00 Received 200
D 2024-02-01 21:35:32.902296+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-01 21:35:32.905535+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.905802+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.905946+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.906070+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.906170+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.906280+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.906390+00:00 ignoring h-entry with no u-url!
D 2024-02-01 21:35:32.906496+00:00 ignoring h-entry with no u-url!
I 2024-02-01 21:35:32.906768+00:00 requests.head https://blog.coryd.dev/ {'headers': {}}
W 2024-02-01 21:35:32.956699+00:00 Couldn't resolve URL https://blog.coryd.dev/ : HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e16521870d0>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
W 2024-02-01 21:35:32.957037+00:00 Couldn't resolve URL https://blog.coryd.dev/: https://blog.coryd.dev/
D 2024-02-01 21:35:32.958188+00:00 fetching author url https://blog.coryd.dev/
I 2024-02-01 21:35:32.958375+00:00 requests.get https://blog.coryd.dev/ {'gateway': False, 'headers': {}}
I 2024-02-01 21:35:32.963949+00:00 Could not fetch author url https://blog.coryd.dev/
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 203, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.runtime/python/lib/python3.11/socket.py", line 962, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -2] Name or service not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 790, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1096, in _validate_conn
conn.connect()
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 611, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connection.py", line 210, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x3e1678039d50>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/connectionpool.py", line 844, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e1678039d50>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/original_post_discovery.py", line 300, in _process_author
author_mf2 = util.fetch_mf2(author_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 273, in fetch_mf2
return util.fetch_mf2(url, get_fn=requests_get, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 2223, in fetch_mf2
resp = get_fn(fragmentless(url), gateway=gateway, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/util.py", line 268, in requests_get
return util.requests_get(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/oauth_dropins/webutil/util.py", line 1662, in call
resp = getattr((session or requests), fn)(url, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='blog.coryd.dev', port=443): Max retries exceeded with url: / (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x3e1678039d50>: Failed to resolve 'blog.coryd.dev' ([Errno -2] Name or service not known)"))
D 2024-02-01 21:35:32.991056+00:00 posse post discovery found no relationship for https://social.lol/@cory/111858334607604782
I 2024-02-01 21:35:33.174823+00:00 https://social.lol/@cory/111858334607604782 has 1 webmention target(s): https://darkvisitors.com/
I 2024-02-01 21:35:33.175193+00:00 requests.get https://social.lol/api/v1/blocks?limit=100 {'headers': {'Authorization': '...'}}
I 2024-02-01 21:35:33.528148+00:00 Received 200
D 2024-02-01 21:35:33.611492+00:00 New webmentions to propagate! Response comment tag:social.lol,2013:111858355945227277 https://social.lol/@andyn/111858355945227277
I 2024-02-01 21:35:33.648352+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/3869491501482854087 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cjQLEghSZXNwb25zZSImdGFnOnNvY2lhbC5sb2wsMjAxMzoxMTE4NTgzNTU5NDUyMjcyNzcM', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-02-01 21:35:33.703263+00:00 https://social.lol/@cory/111858334607604782 has 1 webmention target(s): https://darkvisitors.com/
D 2024-02-01 21:35:33.752348+00:00 New webmentions to propagate! Response comment tag:social.lol,2013:111858360265430541 https://social.lol/@cory/111858360265430541
I 2024-02-01 21:35:33.797946+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/6356187980736272001 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cjQLEghSZXNwb25zZSImdGFnOnNvY2lhbC5sb2wsMjAxMzoxMTE4NTgzNjAyNjU0MzA1NDEM', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-02-01 21:35:34.362222+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-04-05 01:01:07.886830+00:00
I 2024-02-01 21:35:34.389228+00:00 Updating @cory@social.lol (Mastodon) /mastodon/@cory@social.lol : {'last_public_post': datetime.datetime(2024, 2, 1, 21, 32, 4, 168000), 'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 1, 21, 35, 26, 62211, tzinfo=datetime.timezone.utc), 'poll_status': 'ok'}
I 2024-02-01 21:35:34.504203+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/3248294071057047714 with ETA 1706825352: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5ch4LEghNYXN0b2RvbiIQQGNvcnlAc29jaWFsLmxvbAw&last_polled=2024-02-01-21-35-26', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1706825352
}