D 2024-02-06 08:57:47.007308+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-05-05-05-07')]
I 2024-02-06 08:57:47.044104+00:00 Source: joshuap (GitHub) joshuap, https://brid.gy/github/joshuap
I 2024-02-06 08:57:47.044494+00:00 Last poll: https://brid.gy/log?start_time=1707109507&key=agdicmlkLWd5chMLEgZHaXRIdWIiB2pvc2h1YXAM
I 2024-02-06 08:57:47.064077+00:00 Updating joshuap (GitHub) /github/joshuap : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 6, 8, 57, 47, 44625, tzinfo=datetime.timezone.utc), 'rate_limited': False}
D 2024-02-06 08:57:47.136175+00:00 Using ETag Wed, 31 Jan 2024 17:46:54 GMT, last activity id twbs:bootstrap:39235
I 2024-02-06 08:57:47.151176+00:00 no refresh_token
I 2024-02-06 08:57:47.151533+00:00 requests.get https://api.github.com/notifications?all=true&participating=true&per_page=10 {'headers': {'If-Modified-Since': '...', 'Authorization': '...'}}
I 2024-02-06 08:57:48.028260+00:00 Received 200
I 2024-02-06 08:57:48.028584+00:00 requests.get https://api.github.com/repos/rails/rails/issues/50452 {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:48.283414+00:00 Received 200
I 2024-02-06 08:57:48.285876+00:00 requests.get https://api.github.com/repos/honeybadger-io/incoming/pulls/70 {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:48.777775+00:00 Received 200
I 2024-02-06 08:57:48.784222+00:00 requests.get https://api.github.com/repos/rails/rails/issues/50452/comments?since=2024-01-31T17:46:54Z {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:49.042993+00:00 Received 200
I 2024-02-06 08:57:49.045595+00:00 requests.get https://api.github.com/repos/rails/rails/issues/50452/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:49.520260+00:00 Received 200
I 2024-02-06 08:57:49.532825+00:00 requests.get https://api.github.com/repos/honeybadger-io/incoming/issues/70/comments?since=2024-01-31T17:46:54Z {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:49.808215+00:00 Received 200
I 2024-02-06 08:57:49.809971+00:00 requests.get https://api.github.com/repos/honeybadger-io/incoming/issues/70/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 08:57:50.177561+00:00 Received 200
I 2024-02-06 08:57:50.189151+00:00 Found 2 public activities: dict_keys(['tag:github.com,2013:rails:rails:50452', 'tag:github.com,2013:honeybadger-io:incoming:70'])
I 2024-02-06 08:57:50.189388+00:00 Found 0 private activities: dict_keys([])
D 2024-02-06 08:57:50.192152+00:00 discovering original posts for: https://github.com/rails/rails/issues/50452
I 2024-02-06 08:57:50.192683+00:00 requests.head https://github.com/rails/rails/labels/railties {'headers': {}}
I 2024-02-06 08:57:50.668828+00:00 Received 404
W 2024-02-06 08:57:50.669083+00:00 Couldn't resolve URL https://github.com/rails/rails/labels/railties: https://github.com/rails/rails/labels/railties
I 2024-02-06 08:57:50.669344+00:00 Original post discovery found original posts set(), mentions {'https://github.com/rails/rails/labels/railties'}
I 2024-02-06 08:57:50.670120+00:00 requests.head https://github.com/rails/rails/issues/50452 {'headers': None}
I 2024-02-06 08:57:51.116063+00:00 Received 200
I 2024-02-06 08:57:51.116410+00:00 starting posse post discovery with syndicated https://github.com/rails/rails/issues/50452
D 2024-02-06 08:57:51.327212+00:00 activity[content] > we should add structured json logging on a per-request basis

Good initiative!

Maybe `logfmt` (https://brandur.org/logfmt) could be supported as an output alternative to JSON?

Assuming it's all strings and only one level deep (that's how JSON log lines are usually structured), logfmt is 1:1 with JSON log lines, so it's only a matter of output. => > we should add structured json logging on a per-request basis

Good initiative!

Maybe `logfmt` (https://brandur.org/logfmt) could be supported as an output alternative to JSON?

Assuming it's all strings and only one level deep (that's how JSON log lines are usually structured), logfmt is 1:1 with JSON log lines, so it's only a matter of output.

***

Also, maybe this is an area where an RFC light might be useful.

Just write down a rough plan on the interface and output structure, and ask a few large Rails users (Shopify, Zendesk, Github, etc) to provide feedback.
I 2024-02-06 08:57:51.327641+00:00 Response changed! Re-propagating. Original: Response(key=Key('Response', 'tag:github.com,2013:rails:rails:IC_kwDNIULOcgM-NA'), activities_json=['{"id":"tag:github.com,2013:rails:rails:50452","url":"https://github.com/rails/rails/issues/50452","content":"When you want to aggregate the data from your Rails application into a data analysis platform, it\'s a real pain trying to parse the developer-focused log lines that Rails spits out by default. In addition to these log lines, which are great in development and for manual inspection, we should add structured json logging on a per-request basis that can easily be digested by analytics.\\n\\nBoth Shopify and 37signals have been using in-house structured logging for a long time, so extracting something from those battle-tested scenarios is the path we intend to go.\\n\\ncc @Jeremy @rafaelfranca "}'], created=DatetimeWithNanoseconds(2024, 1, 27, 7, 8, 25, 674980, tzinfo=datetime.timezone.utc), error=[], failed=[], leased_until=None, old_response_jsons=[], original_posts=[], response_json='{"id":"tag:github.com,2013:rails:rails:IC_kwDNIULOcgM-NA","url":"https://github.com/rails/rails/issues/50452#issuecomment-1912815156","author":{"id":"tag:github.com,2013:MDQ6VXNlcjEyMjI4Nw==","url":"https://github.com/sandstrom","displayName":"sandstrom","objectType":"person","username":"sandstrom","image":{"url":"https://avatars.githubusercontent.com/u/122287?v=4"}},"content":"> we should add structured json logging on a per-request basis\\n\\nGood initiative!\\n\\nMaybe `logfmt` (https://brandur.org/logfmt) could be supported as an output alternative to JSON?\\n\\nAssuming it\'s all strings and only one level deep (that\'s how JSON log lines are usually structured), logfmt is 1:1 with JSON log lines, so it\'s only a matter of output.","published":"2024-01-26T23:13:39+00:00","updated":"2024-01-26T23:13:39+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/rails/rails/issues/50452"}]}', sent=[], skipped=[], source=Key('GitHub', 'joshuap'), status='complete', type='comment', unsent=[], updated=datetime.datetime(2024, 2, 6, 8, 57, 51, 273706, tzinfo=datetime.timezone.utc), urls_to_activity=None)
I 2024-02-06 08:57:51.487248+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/6030451806527467118 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cj8LEghSZXNwb25zZSIxdGFnOmdpdGh1Yi5jb20sMjAxMzpyYWlsczpyYWlsczpJQ19rd0ROSVVMT2NnTS1OQQw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
I 2024-02-06 08:57:54.380538+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2023-11-06 03:00:10.571418+00:00
I 2024-02-06 08:57:54.402011+00:00 Updating joshuap (GitHub) /github/joshuap : {'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 6, 8, 57, 47, 44625, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_activities_etag': 'Tue, 06 Feb 2024 08:56:05 GMT'}
I 2024-02-06 08:57:54.511270+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/85017864300075664441 with ETA 1707284674: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5chMLEgZHaXRIdWIiB2pvc2h1YXAM&last_polled=2024-02-06-08-57-47', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707284674
}