D 2024-02-06 04:31:16.007223+00:00 Params: [('source_key', 'agdicmlk...'), ('last_polled', '2024-02-05-07-00-33')]
I 2024-02-06 04:31:16.027986+00:00 Source: imdario (GitHub) imdario, https://brid.gy/github/imdario
I 2024-02-06 04:31:16.028364+00:00 Last poll: https://brid.gy/log?start_time=1707116433&key=agdicmlkLWd5chMLEgZHaXRIdWIiB2ltZGFyaW8M
I 2024-02-06 04:31:16.115000+00:00 Updating imdario (GitHub) /github/imdario : {'poll_status': 'polling', 'last_poll_attempt': datetime.datetime(2024, 2, 6, 4, 31, 16, 28465, tzinfo=datetime.timezone.utc), 'rate_limited': False}
D 2024-02-06 04:31:16.199146+00:00 Using ETag Fri, 02 Feb 2024 23:05:44 GMT, last activity id zeit:hyper:2175
I 2024-02-06 04:31:16.225600+00:00 no refresh_token
I 2024-02-06 04:31:16.225974+00:00 requests.get https://api.github.com/notifications?all=true&participating=true&per_page=10 {'headers': {'If-Modified-Since': '...', 'Authorization': '...'}}
I 2024-02-06 04:31:16.899780+00:00 Received 200
I 2024-02-06 04:31:16.900422+00:00 requests.get https://api.github.com/repos/kubernetes/kubernetes/issues/107499 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:17.199009+00:00 Received 200
I 2024-02-06 04:31:17.202003+00:00 requests.get https://api.github.com/repos/bluesky-social/social-app/pulls/2644 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:17.622306+00:00 Received 200
I 2024-02-06 04:31:17.624993+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/pulls/2368 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:18.228266+00:00 Received 200
I 2024-02-06 04:31:18.231220+00:00 requests.get https://api.github.com/repos/DataDog/system-tests/pulls/1853 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:18.562802+00:00 Received 200
I 2024-02-06 04:31:18.565520+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/pulls/22261 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:18.948184+00:00 Received 200
I 2024-02-06 04:31:18.950758+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/pulls/21715 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:19.424967+00:00 Received 200
I 2024-02-06 04:31:19.427739+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/pulls/22534 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:19.833945+00:00 Received 200
I 2024-02-06 04:31:19.836527+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/pulls/22051 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:20.316014+00:00 Received 200
I 2024-02-06 04:31:20.318612+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/pulls/22457 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:20.708764+00:00 Received 200
I 2024-02-06 04:31:20.711268+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/pulls/2538 {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:21.042711+00:00 Received 200
I 2024-02-06 04:31:21.045363+00:00 requests.get https://api.github.com/repos/kubernetes/kubernetes/issues/107499/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:21.339794+00:00 Received 200
I 2024-02-06 04:31:21.343251+00:00 requests.get https://api.github.com/repos/kubernetes/kubernetes/issues/107499/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:21.678795+00:00 Received 200
I 2024-02-06 04:31:21.682379+00:00 requests.get https://api.github.com/repos/bluesky-social/social-app/issues/2644/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:22.013331+00:00 Received 200
I 2024-02-06 04:31:22.015744+00:00 requests.get https://api.github.com/repos/bluesky-social/social-app/issues/2644/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:22.342145+00:00 Received 200
I 2024-02-06 04:31:22.344677+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/issues/2368/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:22.661083+00:00 Received 200
I 2024-02-06 04:31:22.664784+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/issues/2368/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:22.987191+00:00 Received 200
I 2024-02-06 04:31:22.989215+00:00 requests.get https://api.github.com/repos/DataDog/system-tests/issues/1853/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:23.292735+00:00 Received 200
I 2024-02-06 04:31:23.295640+00:00 requests.get https://api.github.com/repos/DataDog/system-tests/issues/1853/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:23.657057+00:00 Received 200
I 2024-02-06 04:31:23.658967+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22261/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:24.050011+00:00 Received 200
I 2024-02-06 04:31:24.053826+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22261/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:24.417059+00:00 Received 200
I 2024-02-06 04:31:24.419196+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/21715/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:24.724509+00:00 Received 200
I 2024-02-06 04:31:24.729586+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/21715/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:25.070882+00:00 Received 200
I 2024-02-06 04:31:25.072868+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22534/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:25.402497+00:00 Received 200
I 2024-02-06 04:31:25.405666+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22534/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:25.740189+00:00 Received 200
I 2024-02-06 04:31:25.742517+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22051/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:26.070663+00:00 Received 200
I 2024-02-06 04:31:26.073160+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22051/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:26.378242+00:00 Received 200
I 2024-02-06 04:31:26.380057+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22457/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:26.692548+00:00 Received 200
I 2024-02-06 04:31:26.695339+00:00 requests.get https://api.github.com/repos/DataDog/datadog-agent/issues/22457/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:27.093132+00:00 Received 200
I 2024-02-06 04:31:27.095104+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/issues/2538/comments?since=2024-02-02T23:05:44Z {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:27.392089+00:00 Received 200
I 2024-02-06 04:31:27.393876+00:00 requests.get https://api.github.com/repos/DataDog/dd-trace-go/issues/2538/reactions {'headers': {'Authorization': '...'}}
I 2024-02-06 04:31:27.684259+00:00 Received 200
I 2024-02-06 04:31:27.691281+00:00 Found 10 public activities: dict_keys(['tag:github.com,2013:kubernetes:kubernetes:107499', 'tag:github.com,2013:bluesky-social:social-app:2644', 'tag:github.com,2013:DataDog:dd-trace-go:2368', 'tag:github.com,2013:DataDog:system-tests:1853', 'tag:github.com,2013:DataDog:datadog-agent:22261', 'tag:github.com,2013:DataDog:datadog-agent:21715', 'tag:github.com,2013:DataDog:datadog-agent:22534', 'tag:github.com,2013:DataDog:datadog-agent:22051', 'tag:github.com,2013:DataDog:datadog-agent:22457', 'tag:github.com,2013:DataDog:dd-trace-go:2538'])
I 2024-02-06 04:31:27.691454+00:00 Found 0 private activities: dict_keys([])
D 2024-02-06 04:31:27.699264+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: e29fe41d-17b4-488e-9dff-9072a0b27d72
Baseline: df258c125578af24c1f055797a72dd56d4fd8538
Comparison: 32dd26001789fc9c09d19ad4414d76d78105e23a
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | idle | memory utilization | -0.24 | [-0.26, -0.21] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | otel_to_otel_logs | ingress throughput | +4.19 | [+3.39, +4.99] |
| ➖ | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.39 | [+0.36, +0.42] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.14 | [+0.08, +0.19] |
| ➖ | process_agent_standard_check | memory utilization | +0.07 | [+0.03, +0.11] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.00 | [-0.02, +0.02] |
| ➖ | trace_agent_json | ingress throughput | -0.05 | [-0.09, -0.01] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.20 | [-0.24, -0.16] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | idle | memory utilization | -0.24 | [-0.26, -0.21] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.82 | [-3.24, -0.39] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: 53593fc8-adaa-4307-96b5-c1b1ac943a6b
Baseline: df258c125578af24c1f055797a72dd56d4fd8538
Comparison: dfc864c43777650afaf3c61ec920c5629a2e9902
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | +0.23 | [+0.20, +0.26] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.07] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.93 | [+0.87, +0.99] |
| ➖ | process_agent_standard_check | memory utilization | +0.83 | [+0.79, +0.88] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.33 | [+0.30, +0.36] |
| ➖ | idle | memory utilization | +0.23 | [+0.20, +0.26] |
| ➖ | trace_agent_json | ingress throughput | +0.06 | [+0.03, +0.09] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.05 | [+0.04, +0.07] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.43 | [-0.47, -0.39] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.07] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.43 | [-2.85, -0.01] |
| ➖ | otel_to_otel_logs | ingress throughput | -3.00 | [-3.74, -2.26] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
D 2024-02-06 04:31:27.699513+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: ed5d1888-8a52-4e46-8fcb-7e8bbba39cd1
Baseline: 07f52731916b22921262834668e41f7d2196abb4
Comparison: 5fe0d281b76d4fdd550e34b13621ba2a12067b85
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | +0.74 | [+0.69, +0.79] |
| ➖ | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |
| ➖ | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +1.19 | [+1.14, +1.25] |
| ➖ | idle | memory utilization | +0.74 | [+0.69, +0.79] |
| ➖ | process_agent_standard_check | memory utilization | +0.39 | [+0.33, +0.44] |
| ➖ | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |
| ➖ | trace_agent_json | ingress throughput | +0.02 | [-0.01, +0.04] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.00 | [-0.02, +0.02] |
| ➖ | process_agent_real_time_mode | memory utilization | -0.15 | [-0.19, -0.10] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.46 | [-1.89, +0.96] |
| ➖ | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.99 | [-1.04, -0.94] |
| ➖ | otel_to_otel_logs | ingress throughput | -1.52 | [-2.23, -0.81] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: a64a1d10-6217-45be-b696-b8c464553a79
Baseline: ea7d79be5f4438de2ca505cbc067b8c79be26480
Comparison: 92340df056c9bd83a28315962e63f5c29cc5decc
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | -0.33 | [-0.38, -0.28] |
| ➖ | file_tree | memory utilization | -0.45 | [-0.55, -0.36] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.08] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | process_agent_real_time_mode | memory utilization | +0.27 | [+0.23, +0.31] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.13 | [+0.07, +0.20] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.07 | [+0.05, +0.08] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | -0.00 | [-0.06, +0.06] |
| ➖ | trace_agent_json | ingress throughput | -0.05 | [-0.08, -0.02] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.10 | [-0.15, -0.05] |
| ➖ | idle | memory utilization | -0.33 | [-0.38, -0.28] |
| ➖ | file_tree | memory utilization | -0.45 | [-0.55, -0.36] |
| ➖ | process_agent_standard_check | memory utilization | -0.47 | [-0.52, -0.41] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.08] |
| ➖ | otel_to_otel_logs | ingress throughput | -0.63 | [-1.35, +0.08] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.11 | [-2.55, +0.33] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
D 2024-02-06 04:31:27.699637+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: f41b6a90-cbb6-4663-81fb-eec1b665cbbd
Baseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b
Comparison: 44023b7266ce767fceea0ab61c56118203e380a1
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## Significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ❌ | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | -0.08 | [-0.13, -0.03] |
| ➖ | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |
| ➖ | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.64 | [+0.58, +0.70] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | +0.60 | [+0.56, +0.64] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.33 | [+0.30, +0.35] |
| ➖ | process_agent_standard_check | memory utilization | +0.06 | [+0.00, +0.11] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.02 | [-0.04, +0.01] |
| ➖ | trace_agent_json | ingress throughput | -0.03 | [-0.06, -0.00] |
| ➖ | idle | memory utilization | -0.08 | [-0.13, -0.03] |
| ➖ | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |
| ➖ | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.37 | [-1.80, +1.07] |
| ❌ | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: c2d65231-d881-48ed-a08f-2d866e232bab
Baseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b
Comparison: 565cf375ca9818be913352c06bd142d2655b2eea
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | file_tree | memory utilization | +0.93 | [+0.86, +1.00] |
| ➖ | file_to_blackhole | % cpu utilization | +0.35 | [-6.24, +6.93] |
| ➖ | idle | memory utilization | +0.30 | [+0.28, +0.33] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | otel_to_otel_logs | ingress throughput | +2.09 | [+1.37, +2.80] |
| ➖ | file_tree | memory utilization | +0.93 | [+0.86, +1.00] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.44 | [+0.41, +0.46] |
| ➖ | file_to_blackhole | % cpu utilization | +0.35 | [-6.24, +6.93] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | +0.31 | [+0.26, +0.35] |
| ➖ | idle | memory utilization | +0.30 | [+0.28, +0.33] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.02 | [-0.03, +0.00] |
| ➖ | trace_agent_json | ingress throughput | -0.02 | [-0.05, +0.02] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.18 | [-1.61, +1.25] |
| ➖ | process_agent_standard_check | memory utilization | -0.28 | [-0.33, -0.24] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | -0.64 | [-0.71, -0.58] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
D 2024-02-06 04:31:27.699755+00:00 discovering original posts for: https://github.com/kubernetes/kubernetes/issues/107499
I 2024-02-06 04:31:27.700537+00:00 requests.head https://github.com/kubernetes/kubernetes/labels/kind/bug {'headers': {}}
I 2024-02-06 04:31:28.155624+00:00 Received 404
W 2024-02-06 04:31:28.155897+00:00 Couldn't resolve URL https://github.com/kubernetes/kubernetes/labels/kind/bug: https://github.com/kubernetes/kubernetes/labels/kind/bug
I 2024-02-06 04:31:28.156114+00:00 requests.head https://github.com/kubernetes/kubernetes/labels/sig/api-machinery {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:31:28.602294+00:00 Received 404
W 2024-02-06 04:31:28.602556+00:00 Couldn't resolve URL https://github.com/kubernetes/kubernetes/labels/sig/api-machinery: https://github.com/kubernetes/kubernetes/labels/sig/api-machinery
I 2024-02-06 04:31:28.603016+00:00 requests.head https://github.com/kubernetes/kubernetes/labels/help%20wanted {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:31:28.923095+00:00 Received 404
W 2024-02-06 04:31:28.923369+00:00 Couldn't resolve URL https://github.com/kubernetes/kubernetes/labels/help%20wanted: https://github.com/kubernetes/kubernetes/labels/help%20wanted
I 2024-02-06 04:31:28.923585+00:00 requests.head https://github.com/kubernetes/kubernetes/labels/lifecycle/stale {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:31:29.393071+00:00 Received 404
W 2024-02-06 04:31:29.393352+00:00 Couldn't resolve URL https://github.com/kubernetes/kubernetes/labels/lifecycle/stale: https://github.com/kubernetes/kubernetes/labels/lifecycle/stale
I 2024-02-06 04:31:29.393582+00:00 requests.head https://github.com/kubernetes/kubernetes/labels/triage/accepted {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:31:29.845100+00:00 Received 404
W 2024-02-06 04:31:29.845359+00:00 Couldn't resolve URL https://github.com/kubernetes/kubernetes/labels/triage/accepted: https://github.com/kubernetes/kubernetes/labels/triage/accepted
I 2024-02-06 04:31:29.845599+00:00 requests.head https://1.1.1.1:8001/ {'headers': {'User-Agent': '...'}}
W 2024-02-06 04:31:44.849078+00:00 Couldn't resolve URL https://1.1.1.1:8001/ : HTTPSConnectionPool(host='1.1.1.1', port=8001): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e0c713af5d0>, 'Connection to 1.1.1.1 timed out. (connect timeout=15)'))
W 2024-02-06 04:31:44.849423+00:00 Couldn't resolve URL https://1.1.1.1:8001/: https://1.1.1.1:8001/
I 2024-02-06 04:31:44.849698+00:00 requests.head https://2.2.2.2:8001/ {'headers': {'User-Agent': '...'}}
W 2024-02-06 04:31:59.878586+00:00 Couldn't resolve URL https://2.2.2.2:8001/ : HTTPSConnectionPool(host='2.2.2.2', port=8001): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x3e0c53f56b10>, 'Connection to 2.2.2.2 timed out. (connect timeout=15)'))
W 2024-02-06 04:31:59.878950+00:00 Couldn't resolve URL https://2.2.2.2:8001/: https://2.2.2.2:8001/
I 2024-02-06 04:31:59.879595+00:00 requests.head http://github.com/istio/istio {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:00.656428+00:00 Redirected to https://github.com/istio/istio
I 2024-02-06 04:32:00.656793+00:00 Received 200
D 2024-02-06 04:32:00.656901+00:00 Resolved http://github.com/istio/istio to https://github.com/istio/istio
I 2024-02-06 04:32:00.657337+00:00 Original post discovery found original posts set(), mentions {'https://github.com/kubernetes/kubernetes/labels/kind/bug', 'https://github.com/istio/istio', 'https://2.2.2.2:8001/', 'https://1.1.1.1:8001/', 'https://github.com/kubernetes/kubernetes/labels/help%20wanted', 'https://github.com/kubernetes/kubernetes/labels/lifecycle/stale', 'https://github.com/kubernetes/kubernetes/labels/sig/api-machinery', 'https://github.com/kubernetes/kubernetes/labels/triage/accepted'}
I 2024-02-06 04:32:00.659693+00:00 requests.head https://github.com/kubernetes/kubernetes/issues/107499 {'headers': None}
I 2024-02-06 04:32:01.489305+00:00 Received 200
I 2024-02-06 04:32:01.489657+00:00 starting posse post discovery with syndicated https://github.com/kubernetes/kubernetes/issues/107499
D 2024-02-06 04:32:02.581558+00:00 discovering original posts for: https://github.com/bluesky-social/social-app/pull/2644
I 2024-02-06 04:32:02.581954+00:00 requests.head https://github.com/bluesky-social/social-app/labels/intl {'headers': {}}
I 2024-02-06 04:32:03.401064+00:00 Received 404
W 2024-02-06 04:32:03.401258+00:00 Couldn't resolve URL https://github.com/bluesky-social/social-app/labels/intl: https://github.com/bluesky-social/social-app/labels/intl
I 2024-02-06 04:32:03.401650+00:00 Original post discovery found original posts set(), mentions {'https://github.com/bluesky-social/social-app/labels/intl'}
I 2024-02-06 04:32:03.402175+00:00 requests.head https://github.com/bluesky-social/social-app/pull/2644 {'headers': None}
I 2024-02-06 04:32:05.203826+00:00 Received 200
I 2024-02-06 04:32:05.204163+00:00 starting posse post discovery with syndicated https://github.com/bluesky-social/social-app/pull/2644
D 2024-02-06 04:32:05.422772+00:00 discovering original posts for: https://github.com/DataDog/dd-trace-go/pull/2368
I 2024-02-06 04:32:05.423523+00:00 requests.head https://github.com/DataDog/dd-trace-go/pull/2349 {'headers': {}}
I 2024-02-06 04:32:06.502897+00:00 Received 200
I 2024-02-06 04:32:06.503243+00:00 requests.head https://github.com/DataDog/system-tests/pull/1853 {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:07.618604+00:00 Received 200
I 2024-02-06 04:32:07.619051+00:00 Original post discovery found original posts set(), mentions {'https://github.com/DataDog/dd-trace-go/pull/2349', 'https://github.com/DataDog/system-tests/pull/1853'}
I 2024-02-06 04:32:07.619749+00:00 requests.head https://github.com/DataDog/dd-trace-go/pull/2368 {'headers': None}
I 2024-02-06 04:32:08.721361+00:00 Received 200
I 2024-02-06 04:32:08.721685+00:00 starting posse post discovery with syndicated https://github.com/DataDog/dd-trace-go/pull/2368
D 2024-02-06 04:32:08.952089+00:00 activity[content] ## Benchmarks

Benchmark execution time: 2023-11-20 02:04:54

Comparing candidate commit 70567d295b22dc1c265750801becf766c94ea954 in PR branch `jennie.gao/cherrypick-3b07dd2` with baseline commit 70bc63c4f6f6e932da62162dc3b6a5939c22349d in branch `main`.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 39 metrics, 2 unstable metrics.

=> ## Benchmarks

Benchmark execution time: 2024-02-05 22:03:25

Comparing candidate commit d8d48d48daa67b6ae70676a0c37359b6efee0d1e in PR branch `jennie.gao/cherrypick-3b07dd2` with baseline commit 42593ee3a038c0f5e0a1c1d5323ed99054ea6168 in branch `main`.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 39 metrics, 2 unstable metrics.


I 2024-02-06 04:32:08.952513+00:00 Response changed! Re-propagating. Original: Response(key=Key('Response', 'tag:github.com,2013:DataDog:dd-trace-go:IC_kwDOBAi6ic5sTLNO'), activities_json=['{"id":"tag:github.com,2013:DataDog:dd-trace-go:2368","url":"https://github.com/DataDog/dd-trace-go/pull/2368","content":"<!--\\n* New contributors are highly encouraged to read our\\n [CONTRIBUTING](/CONTRIBUTING.md) documentation.\\n* Commit and PR titles should be prefixed with the general area of the pull request\'s change.\\n\\n-->\\n### What does this PR do?\\nThis PR switch default context propagation order from tracecontext,datadog to datadog,tracecontext\\n[The same change is merged into `v2-dev` branch](https://github.com/DataDog/dd-trace-go/pull/2349), this PR is to cherry pick the same commit to `main` so system test can run with the new default context propagation order.\\nSystem test change: https://github.com/DataDog/system-tests/pull/1853\\n\\n<!--\\n* A brief description of the change being made with this pull request.\\n* If the description here cannot be expressed in a succinct form, consider\\n opening multiple pull requests instead of a single one.\\n-->\\n\\n### Motivation\\n\\n<!--\\n* What inspired you to submit this pull request?\\n* Link any related GitHub issues or PRs here.\\n* If this resolves a GitHub issue, include \\"Fixes #XXXX\\" to link the issue and auto-close it on merge.\\n-->\\n\\n### Reviewer\'s Checklist\\n<!--\\n* Authors can use this list as a reference to ensure that there are no problems\\n during the review but the signing off is to be done by the reviewer(s).\\n-->\\n\\n- [ ] Changed code ... unit tests for its functionality at or near 100% coverage.\\n- [ ] There is a benchmark for any new code, ... changes to existing code.\\n- [ ] If this interacts with the agent in a new way, a system test has been added.\\n- [ ] Add an appropriate team label so this PR gets put in the right place for the release notes.\\n\\nFor Datadog employees:\\n\\n- [ ] If this PR touches code ... handles credentials of any kind, such as Datadog API keys, I\'ve requested a review from `@DataDog/security-design-and-guidance`.\\n- [ ] This PR doesn\'t touch any of that.\\n\\nUnsure? Have a question? Request a review!\\n"}'], created=DatetimeWithNanoseconds(2023, 11, 17, 21, 36, 41, 982978, tzinfo=datetime.timezone.utc), error=[], failed=[], leased_until=DatetimeWithNanoseconds(2023, 11, 20, 16, 2, 4, 659218, tzinfo=datetime.timezone.utc), old_response_jsons=['{"id":"tag:github.com,2013:DataDog:dd-trace-go:IC_kwDOBAi6ic5sTLNO","url":"https://github.com/DataDog/dd-trace-go/pull/2368#issuecomment-1816965966","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","objectType":"person","displayName":"pr-commenter[bot]","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Benchmarks\\n\\nBenchmark execution time: 2023-11-17 19:24:00\\n\\nComparing candidate commit 53eac9c9137ab14a68324016fa891bd3a42fe783 in PR branch `jennie.gao/cherrypick-3b07dd2` with baseline commit 70bc63c4f6f6e932da62162dc3b6a5939c22349d in branch `main`.\\n\\nFound 0 performance improvements and 0 performance regressions! Performance is the same for 41 metrics, 0 unstable metrics.\\n\\n","published":"2023-11-17T19:24:10+00:00","updated":"2023-11-17T19:24:10+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/dd-trace-go/pull/2368"}]}'], original_posts=[], response_json='{"id":"tag:github.com,2013:DataDog:dd-trace-go:IC_kwDOBAi6ic5sTLNO","url":"https://github.com/DataDog/dd-trace-go/pull/2368#issuecomment-1816965966","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","objectType":"person","displayName":"pr-commenter[bot]","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Benchmarks\\n\\nBenchmark execution time: 2023-11-20 02:04:54\\n\\nComparing candidate commit 70567d295b22dc1c265750801becf766c94ea954 in PR branch `jennie.gao/cherrypick-3b07dd2` with baseline commit 70bc63c4f6f6e932da62162dc3b6a5939c22349d in branch `main`.\\n\\nFound 0 performance improvements and 0 performance regressions! Performance is the same for 39 metrics, 2 unstable metrics.\\n\\n","published":"2023-11-17T19:24:10+00:00","updated":"2023-11-20T02:05:05+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/dd-trace-go/pull/2368"}]}', sent=[], skipped=[], source=Key('GitHub', 'imdario'), status='complete', type='comment', unsent=[], updated=datetime.datetime(2024, 2, 6, 4, 32, 8, 833579, tzinfo=datetime.timezone.utc), urls_to_activity=None)
I 2024-02-06 04:32:09.136858+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/8064293559038342139 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5ckkLEghSZXNwb25zZSI7dGFnOmdpdGh1Yi5jb20sMjAxMzpEYXRhRG9nOmRkLXRyYWNlLWdvOklDX2t3RE9CQWk2aWM1c1RMTk8M', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-06 04:32:09.632795+00:00 discovering original posts for: https://github.com/DataDog/datadog-agent/pull/22261
I 2024-02-06 04:32:09.633662+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/changelog/no-changelog {'headers': {}}
I 2024-02-06 04:32:10.269331+00:00 Received 404
W 2024-02-06 04:32:10.269615+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/changelog/no-changelog: https://github.com/DataDog/datadog-agent/labels/changelog/no-changelog
I 2024-02-06 04:32:10.269839+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/team/agent-apm {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:11.190367+00:00 Received 404
W 2024-02-06 04:32:11.190625+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/team/agent-apm: https://github.com/DataDog/datadog-agent/labels/team/agent-apm
I 2024-02-06 04:32:11.190903+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/qa/skip-qa {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:11.759872+00:00 Received 404
W 2024-02-06 04:32:11.760118+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/qa/skip-qa: https://github.com/DataDog/datadog-agent/labels/qa/skip-qa
I 2024-02-06 04:32:11.760324+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:12.068828+00:00 Received 404
W 2024-02-06 04:32:12.069209+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done: https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done
I 2024-02-06 04:32:12.069476+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/qa/no-code-change {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:12.638049+00:00 Received 404
W 2024-02-06 04:32:12.638329+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/qa/no-code-change: https://github.com/DataDog/datadog-agent/labels/qa/no-code-change
I 2024-02-06 04:32:12.638572+00:00 requests.head https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:12.954973+00:00 Received 200
I 2024-02-06 04:32:12.955339+00:00 requests.head https://github.com/DataDog/documentation/issues/new {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:13.309974+00:00 Redirected to https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew
I 2024-02-06 04:32:13.310331+00:00 Received 200
D 2024-02-06 04:32:13.310447+00:00 Resolved https://github.com/DataDog/documentation/issues/new to https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew
I 2024-02-06 04:32:13.310687+00:00 requests.head https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:13.674694+00:00 Received 200
I 2024-02-06 04:32:13.675215+00:00 Original post discovery found original posts set(), mentions {'https://github.com/DataDog/datadog-agent/labels/team/agent-apm', 'https://github.com/DataDog/datadog-agent/labels/changelog/no-changelog', 'https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done', 'https://github.com/DataDog/datadog-agent/labels/qa/no-code-change', 'https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml', 'https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew', 'https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno', 'https://github.com/DataDog/datadog-agent/labels/qa/skip-qa'}
I 2024-02-06 04:32:13.676225+00:00 requests.head https://github.com/DataDog/datadog-agent/pull/22261 {'headers': None}
I 2024-02-06 04:32:15.362129+00:00 Received 200
I 2024-02-06 04:32:15.362445+00:00 starting posse post discovery with syndicated https://github.com/DataDog/datadog-agent/pull/22261
D 2024-02-06 04:32:15.520471+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: ed5d1888-8a52-4e46-8fcb-7e8bbba39cd1
Baseline: 07f52731916b22921262834668e41f7d2196abb4
Comparison: 5fe0d281b76d4fdd550e34b13621ba2a12067b85
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | +0.74 | [+0.69, +0.79] |
| ➖ | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |
| ➖ | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +1.19 | [+1.14, +1.25] |
| ➖ | idle | memory utilization | +0.74 | [+0.69, +0.79] |
| ➖ | process_agent_standard_check | memory utilization | +0.39 | [+0.33, +0.44] |
| ➖ | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |
| ➖ | trace_agent_json | ingress throughput | +0.02 | [-0.01, +0.04] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.00 | [-0.02, +0.02] |
| ➖ | process_agent_real_time_mode | memory utilization | -0.15 | [-0.19, -0.10] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.46 | [-1.89, +0.96] |
| ➖ | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.99 | [-1.04, -0.94] |
| ➖ | otel_to_otel_logs | ingress throughput | -1.52 | [-2.23, -0.81] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: a64a1d10-6217-45be-b696-b8c464553a79
Baseline: ea7d79be5f4438de2ca505cbc067b8c79be26480
Comparison: 92340df056c9bd83a28315962e63f5c29cc5decc
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | -0.33 | [-0.38, -0.28] |
| ➖ | file_tree | memory utilization | -0.45 | [-0.55, -0.36] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.08] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | process_agent_real_time_mode | memory utilization | +0.27 | [+0.23, +0.31] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.13 | [+0.07, +0.20] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.07 | [+0.05, +0.08] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | -0.00 | [-0.06, +0.06] |
| ➖ | trace_agent_json | ingress throughput | -0.05 | [-0.08, -0.02] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.10 | [-0.15, -0.05] |
| ➖ | idle | memory utilization | -0.33 | [-0.38, -0.28] |
| ➖ | file_tree | memory utilization | -0.45 | [-0.55, -0.36] |
| ➖ | process_agent_standard_check | memory utilization | -0.47 | [-0.52, -0.41] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.08] |
| ➖ | otel_to_otel_logs | ingress throughput | -0.63 | [-1.35, +0.08] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.11 | [-2.55, +0.33] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
I 2024-02-06 04:32:15.521000+00:00 Response changed! Re-propagating. Original: Response(key=Key('Response', 'tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xyrg9'), activities_json=['{"id":"tag:github.com,2013:DataDog:datadog-agent:22261","url":"https://github.com/DataDog/datadog-agent/pull/22261","content":"### What does this PR do?\\n\\nThis PR adds a new, simple e2e test for the trace agent, generating some traces and checking that intake receives what we expect.\\n\\n\\n### Motivation\\n\\nThis will serve as a basic check of the agent, as well as serving as a template for more complicated e2e tests.\\n\\n### Additional Notes\\n\\n<!--\\n* Anything else we should know when reviewing?\\n* Include benchmarking information here whenever possible.\\n* Include info about alternatives that were considered and why the proposed\\n version was chosen.\\n-->\\n\\n### Possible Drawbacks / Trade-offs\\n\\n<!--\\n* What are the possible side-effects or negative impacts of the code ... Describe how to test/QA your changes\\n\\nN/A \\n\\n<!--\\n* Write here in detail or link to detailed instructions on how this change can\\n be tested/QAd/validated, including any environment setup.\\n-->\\n\\n### Reviewer\'s Checklist\\n<!--\\n* Authors can use this list as a reference to ensure that there are no problems\\n during the review but the signing off is to be done by the reviewer(s).\\n\\nNote: Adding GitHub labels is only possible for contributors with write access.\\n-->\\n\\n- [ ] If known, an appropriate milestone has been selected; otherwise the `Triage` milestone is set.\\n- [ ] Use the `major_change` label if your change either has a major impact on the code ... is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.\\n- [ ] A [release note](https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno) has been added or the `changelog/no-changelog` label has been applied.\\n- [ ] Changed code ... automated tests for its functionality.\\n- [ ] Adequate QA/testing plan information is provided. Except if the `qa/skip-qa` label, with required either `qa/done` or `qa/no-code-change` labels, are applied.\\n- [ ] At least one `team/..` label has been applied, indicating the team(s) that should QA this change.\\n- [ ] If applicable, docs team has been notified or [an issue has been opened on the documentation repo](https://github.com/DataDog/documentation/issues/new)..\\n- [ ] If applicable, the `need-change/operator` and `need-change/helm` labels have been applied.\\n- [ ] If applicable, the `k8s/<min-version>` label, indicating the lowest Kubernetes version compatible with this feature.\\n- [ ] If applicable, the [config template](https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml) has been updated.\\n"}'], created=DatetimeWithNanoseconds(2024, 1, 25, 9, 46, 42, 101569, tzinfo=datetime.timezone.utc), error=[], failed=[], leased_until=DatetimeWithNanoseconds(2024, 2, 3, 4, 37, 38, 477660, tzinfo=datetime.timezone.utc), old_response_jsons=['{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xyrg9","url":"https://github.com/DataDog/datadog-agent/pull/22261#issuecomment-1909110845","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: 5131cfb6-b12c-4e34-ad2e-fbe8a7e5aef8\\nBaseline: 439a6123e2800b201aada5acb62a50ce9ffe25e8\\nComparison: 09e85486e3e6e17f524337cdd04f1a7dd230e8d2\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | file_to_blackhole | % cpu utilization | +0.51 | [-6.05, +7.06] |\\n| \\u2796 | idle | memory utilization | +0.07 | [+0.04, +0.09] |\\n| \\u2796 | file_tree | memory utilization | -0.51 | [-0.58, -0.44] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | file_to_blackhole | % cpu utilization | +0.51 | [-6.05, +7.06] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | +0.36 | [+0.32, +0.40] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.15 | [+0.10, +0.21] |\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | +0.14 | [+0.08, +0.20] |\\n| \\u2796 | idle | memory utilization | +0.07 | [+0.04, +0.09] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | +0.02 | [+0.00, +0.04] |\\n| \\u2796 | trace_agent_json | ingress throughput | +0.01 | [-0.02, +0.03] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | -0.00 | [-0.06, +0.06] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.16 | [-1.59, +1.26] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | -0.20 | [-0.24, -0.15] |\\n| \\u2796 | file_tree | memory utilization | -0.51 | [-0.58, -0.44] |\\n| \\u2796 | otel_to_otel_logs | ingress throughput | -1.02 | [-1.77, -0.27] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-24T23:46:30+00:00","updated":"2024-01-31T22:10:13+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/22261"}]}', '{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xyrg9","url":"https://github.com/DataDog/datadog-agent/pull/22261#issuecomment-1909110845","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: 3e329af9-1ce8-41ad-a2b5-a41df7b7d8aa\\nBaseline: cbf62595f5d608ebd64e50493f1254ee966a8dfb\\nComparison: 433c9768dd6e99bb185838c89a43b118b18e568c\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | file_tree | memory utilization | +0.83 | [+0.76, +0.90] |\\n| \\u2796 | idle | memory utilization | +0.16 | [+0.14, +0.19] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.68 | [-7.21, +5.85] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | +1.79 | [+0.35, +3.24] |\\n| \\u2796 | file_tree | memory utilization | +0.83 | [+0.76, +0.90] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.26 | [+0.22, +0.31] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | +0.25 | [+0.21, +0.30] |\\n| \\u2796 | idle | memory utilization | +0.16 | [+0.14, +0.19] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | -0.04 | [-0.06, -0.03] |\\n| \\u2796 | trace_agent_json | ingress throughput | -0.07 | [-0.09, -0.04] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | -0.21 | [-0.24, -0.18] |\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | -0.42 | [-0.48, -0.37] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.68 | [-7.21, +5.85] |\\n| \\u2796 | otel_to_otel_logs | ingress throughput | -1.12 | [-1.81, -0.42] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-24T23:46:30+00:00","updated":"2024-01-24T23:46:30+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/22261"}]}'], original_posts=[], response_json='{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xyrg9","url":"https://github.com/DataDog/datadog-agent/pull/22261#issuecomment-1909110845","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: ed5d1888-8a52-4e46-8fcb-7e8bbba39cd1\\nBaseline: 07f52731916b22921262834668e41f7d2196abb4\\nComparison: 5fe0d281b76d4fdd550e34b13621ba2a12067b85\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | idle | memory utilization | +0.74 | [+0.69, +0.79] |\\n| \\u2796 | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | +1.19 | [+1.14, +1.25] |\\n| \\u2796 | idle | memory utilization | +0.74 | [+0.69, +0.79] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.39 | [+0.33, +0.44] |\\n| \\u2796 | file_tree | memory utilization | +0.37 | [+0.30, +0.45] |\\n| \\u2796 | trace_agent_json | ingress throughput | +0.02 | [-0.01, +0.04] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | -0.00 | [-0.02, +0.02] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | -0.15 | [-0.19, -0.10] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.46 | [-1.89, +0.96] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.93 | [-7.45, +5.60] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | -0.99 | [-1.04, -0.94] |\\n| \\u2796 | otel_to_otel_logs | ingress throughput | -1.52 | [-2.23, -0.81] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-24T23:46:30+00:00","updated":"2024-02-02T21:41:35+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/22261"}]}', sent=[], skipped=[], source=Key('GitHub', 'imdario'), status='complete', type='comment', unsent=[], updated=datetime.datetime(2024, 2, 6, 4, 32, 15, 472776, tzinfo=datetime.timezone.utc), urls_to_activity=None)
I 2024-02-06 04:32:15.678420+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/54296211759165396241 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cksLEghSZXNwb25zZSI9dGFnOmdpdGh1Yi5jb20sMjAxMzpEYXRhRG9nOmRhdGFkb2ctYWdlbnQ6SUNfa3dET0F2cC1NODV4eXJnOQw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-06 04:32:15.854407+00:00 discovering original posts for: https://github.com/DataDog/datadog-agent/pull/21715
I 2024-02-06 04:32:15.855399+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/qa/done {'headers': {}}
I 2024-02-06 04:32:16.395832+00:00 Received 404
W 2024-02-06 04:32:16.396092+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/qa/done: https://github.com/DataDog/datadog-agent/labels/qa/done
I 2024-02-06 04:32:16.396297+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/7.51.0-drop {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:16.962662+00:00 Received 404
W 2024-02-06 04:32:16.962915+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/7.51.0-drop: https://github.com/DataDog/datadog-agent/labels/7.51.0-drop
I 2024-02-06 04:32:16.963120+00:00 requests.head https://github.com/DataDog/datadog-agent/assets/62392438/f18baba6-d698-4515-ae7e-0aa3d79202c1 {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:17.511386+00:00 Redirected to https://github-production-user-asset-6210df.s3.amazonaws.com/62392438/300623701-f18baba6-d698-4515-ae7e-0aa3d79202c1.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240206%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240206T043217Z&X-Amz-Expires=300&X-Amz-Signature=...&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=49970739
I 2024-02-06 04:32:17.511746+00:00 Received 403
W 2024-02-06 04:32:17.511871+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/assets/62392438/f18baba6-d698-4515-ae7e-0aa3d79202c1: https://github-production-user-asset-6210df.s3.amazonaws.com/62392438/300623701-f18baba6-d698-4515-ae7e-0aa3d79202c1.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240206%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240206T043217Z&X-Amz-Expires=300&X-Amz-Signature=...&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=49970739
I 2024-02-06 04:32:17.512386+00:00 Original post discovery found original posts set(), mentions {'https://github.com/DataDog/datadog-agent/labels/team/agent-apm', 'https://github-production-user-asset-6210df.s3.amazonaws.com/62392438/300623701-f18baba6-d698-4515-ae7e-0aa3d79202c1.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240206%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240206T043217Z&X-Amz-Expires=300&X-Amz-Signature=...&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=49970739', 'https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done', 'https://github.com/DataDog/datadog-agent/labels/7.51.0-drop', 'https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml', 'https://github.com/DataDog/datadog-agent/labels/qa/done', 'https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno', 'https://github.com/DataDog/datadog-agent/labels/qa/skip-qa', 'https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew'}
I 2024-02-06 04:32:17.514131+00:00 requests.head https://github.com/DataDog/datadog-agent/pull/21715 {'headers': None}
I 2024-02-06 04:32:18.817846+00:00 Received 200
I 2024-02-06 04:32:18.818289+00:00 starting posse post discovery with syndicated https://github.com/DataDog/datadog-agent/pull/21715
D 2024-02-06 04:32:18.941694+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: f41b6a90-cbb6-4663-81fb-eec1b665cbbd
Baseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b
Comparison: 44023b7266ce767fceea0ab61c56118203e380a1
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## Significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ❌ | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | -0.08 | [-0.13, -0.03] |
| ➖ | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |
| ➖ | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.64 | [+0.58, +0.70] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | +0.60 | [+0.56, +0.64] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.33 | [+0.30, +0.35] |
| ➖ | process_agent_standard_check | memory utilization | +0.06 | [+0.00, +0.11] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.02 | [-0.04, +0.01] |
| ➖ | trace_agent_json | ingress throughput | -0.03 | [-0.06, -0.00] |
| ➖ | idle | memory utilization | -0.08 | [-0.13, -0.03] |
| ➖ | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |
| ➖ | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.37 | [-1.80, +1.07] |
| ❌ | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: c2d65231-d881-48ed-a08f-2d866e232bab
Baseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b
Comparison: 565cf375ca9818be913352c06bd142d2655b2eea
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | file_tree | memory utilization | +0.93 | [+0.86, +1.00] |
| ➖ | file_to_blackhole | % cpu utilization | +0.35 | [-6.24, +6.93] |
| ➖ | idle | memory utilization | +0.30 | [+0.28, +0.33] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | otel_to_otel_logs | ingress throughput | +2.09 | [+1.37, +2.80] |
| ➖ | file_tree | memory utilization | +0.93 | [+0.86, +1.00] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.44 | [+0.41, +0.46] |
| ➖ | file_to_blackhole | % cpu utilization | +0.35 | [-6.24, +6.93] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | +0.31 | [+0.26, +0.35] |
| ➖ | idle | memory utilization | +0.30 | [+0.28, +0.33] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | -0.02 | [-0.03, +0.00] |
| ➖ | trace_agent_json | ingress throughput | -0.02 | [-0.05, +0.02] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.18 | [-1.61, +1.25] |
| ➖ | process_agent_standard_check | memory utilization | -0.28 | [-0.33, -0.24] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | -0.64 | [-0.71, -0.58] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
I 2024-02-06 04:32:18.942225+00:00 Response changed! Re-propagating. Original: Response(key=Key('Response', 'tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xhrpV'), activities_json=['{"id":"tag:github.com,2013:DataDog:datadog-agent:21715","url":"https://github.com/DataDog/datadog-agent/pull/21715","content":"<!--\\n* New contributors are highly encouraged to read our\\n [CONTRIBUTING](/CONTRIBUTING.md) documentation.\\n* The pull request:\\n * Should only fix one issue or add one feature at a time.\\n * Must update the test suite for the relevant functionality.\\n * Should pass all status checks before being reviewed or merged.\\n* Commit titles should be prefixed with general area of pull request\'s change.\\n\\n-->\\n### What does this PR do?\\nAdd Span Links support to the trace agent\\n<!--\\n* A brief description of the change being made with this pull request.\\n* If the description here cannot be expressed in a succinct form, consider\\n opening multiple pull requests instead of a single one.\\n-->\\n\\n### Motivation\\nSpan links are an important feature for distributed traces in messaging systems or where span relationships aren\'t as simple as the current \\"descends from\\" model.\\n<!--\\n* What inspired you to submit this pull request?\\n* Link any related GitHub issues or PRs here.\\n-->\\n\\n### Additional Notes\\n\\n<!--\\n* Anything else we should know when reviewing?\\n* Include benchmarking information here whenever possible.\\n* Include info about alternatives that were considered and why the proposed\\n version was chosen.\\n-->\\n\\n### Possible Drawbacks / Trade-offs\\n\\n<!--\\n* What are the possible side-effects or negative impacts of the code ... Describe how to test/QA your changes\\n\\n<!--\\n* Write here in detail or link to detailed instructions on how this change can\\n be tested/QAd/validated, including any environment setup.\\n-->\\n\\n### Reviewer\'s Checklist\\n<!--\\n* Authors can use this list as a reference to ensure that there are no problems\\n during the review but the signing off is to be done by the reviewer(s).\\n\\nNote: Adding GitHub labels is only possible for contributors with write access.\\n-->\\n\\n- [x] If known, an appropriate milestone has been selected; otherwise the `Triage` milestone is set.\\n- [x] Use the `major_change` label if your change either has a major impact on the code ... is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.\\n- [x] A [release note](https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno) has been added or the `changelog/no-changelog` label has been applied.\\n- [ ] Changed code ... automated tests for its functionality.\\n- [ ] Adequate QA/testing plan information is provided. Except if the `qa/skip-qa` label, with required either `qa/done` or `qa/no-code-change` labels, are applied.\\n- [x] At least one `team/..` label has been applied, indicating the team(s) that should QA this change.\\n- [ ] If applicable, docs team has been notified or [an issue has been opened on the documentation repo](https://github.com/DataDog/documentation/issues/new)..\\n- [ ] If applicable, the `need-change/operator` and `need-change/helm` labels have been applied.\\n- [ ] If applicable, the `k8s/<min-version>` label, indicating the lowest Kubernetes version compatible with this feature.\\n- [ ] If applicable, the [config template](https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml) has been updated.\\n"}'], created=DatetimeWithNanoseconds(2024, 1, 27, 12, 23, 38, 815104, tzinfo=datetime.timezone.utc), error=[], failed=[], leased_until=DatetimeWithNanoseconds(2024, 2, 3, 4, 37, 48, 177693, tzinfo=datetime.timezone.utc), old_response_jsons=['{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xhrpV","url":"https://github.com/DataDog/datadog-agent/pull/21715#issuecomment-1904654933","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: 73edd747-012c-4f08-9102-6e1c4013003b\\nBaseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b\\nComparison: 042304f1b750449d2df8d0c13a61d305c9a5a496\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | idle | memory utilization | +0.85 | [+0.83, +0.87] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | +0.42 | [-6.15, +7.00] |\\n| \\u2796 | file_tree | memory utilization | +0.21 | [+0.14, +0.28] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | otel_to_otel_logs | ingress throughput | +4.11 | [+3.34, +4.89] |\\n| \\u2796 | idle | memory utilization | +0.85 | [+0.83, +0.87] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | +0.42 | [-6.15, +7.00] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.31 | [+0.26, +0.35] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | +0.22 | [+0.19, +0.26] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | +0.21 | [+0.17, +0.25] |\\n| \\u2796 | file_tree | memory utilization | +0.21 | [+0.14, +0.28] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | +0.02 | [-0.00, +0.04] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | -0.00 | [-0.06, +0.06] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |\\n| \\u2796 | trace_agent_json | ingress throughput | -0.02 | [-0.05, +0.01] |\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | -1.16 | [-1.22, -1.09] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -2.83 | [-4.25, -1.42] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-22T19:22:08+00:00","updated":"2024-02-01T17:07:44+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/21715"}]}', '{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xhrpV","url":"https://github.com/DataDog/datadog-agent/pull/21715#issuecomment-1904654933","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: e5950a92-0f0b-40f7-b23d-270e9799ef64\\nBaseline: 4260c809cf7e1bfabb0505c08983cb5fc7730768\\nComparison: 0c237632985dd754f4178f689bd6cd00e436cf80\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | idle | memory utilization | +0.45 | [+0.40, +0.49] |\\n| \\u2796 | file_tree | memory utilization | +0.19 | [+0.08, +0.31] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.09 | [-6.63, +6.45] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | +0.63 | [+0.57, +0.69] |\\n| \\u2796 | idle | memory utilization | +0.45 | [+0.40, +0.49] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.28 | [+0.21, +0.34] |\\n| \\u2796 | file_tree | memory utilization | +0.19 | [+0.08, +0.31] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | +0.11 | [+0.07, +0.16] |\\n| \\u2796 | trace_agent_json | ingress throughput | +0.05 | [+0.03, +0.08] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.05, +0.05] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | -0.03 | [-0.05, -0.02] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.09 | [-6.63, +6.45] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | -0.13 | [-0.18, -0.09] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.37 | [-1.82, +1.08] |\\n| \\u2796 | otel_to_otel_logs | ingress throughput | -1.39 | [-2.11, -0.68] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-22T19:22:08+00:00","updated":"2024-01-26T16:07:37+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/21715"}]}'], original_posts=[], response_json='{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85xhrpV","url":"https://github.com/DataDog/datadog-agent/pull/21715#issuecomment-1904654933","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: f41b6a90-cbb6-4663-81fb-eec1b665cbbd\\nBaseline: 23bb19e6b75f5f3c70c6c5ca69d513f9b424954b\\nComparison: 44023b7266ce767fceea0ab61c56118203e380a1\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## Significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u274c | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | idle | memory utilization | -0.08 | [-0.13, -0.03] |\\n| \\u2796 | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | +0.64 | [+0.58, +0.70] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | +0.60 | [+0.56, +0.64] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | +0.33 | [+0.30, +0.35] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.06 | [+0.00, +0.11] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.03, +0.03] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | -0.02 | [-0.04, +0.01] |\\n| \\u2796 | trace_agent_json | ingress throughput | -0.03 | [-0.06, -0.00] |\\n| \\u2796 | idle | memory utilization | -0.08 | [-0.13, -0.03] |\\n| \\u2796 | file_tree | memory utilization | -0.12 | [-0.20, -0.05] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | -0.23 | [-6.79, +6.34] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -0.37 | [-1.80, +1.07] |\\n| \\u274c | otel_to_otel_logs | ingress throughput | -5.24 | [-5.97, -4.50] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-01-22T19:22:08+00:00","updated":"2024-02-02T16:39:43+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/21715"}]}', sent=[], skipped=[], source=Key('GitHub', 'imdario'), status='complete', type='comment', unsent=[], updated=datetime.datetime(2024, 2, 6, 4, 32, 18, 904855, tzinfo=datetime.timezone.utc), urls_to_activity=None)
I 2024-02-06 04:32:19.079651+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/44522956077856828441 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cksLEghSZXNwb25zZSI9dGFnOmdpdGh1Yi5jb20sMjAxMzpEYXRhRG9nOmRhdGFkb2ctYWdlbnQ6SUNfa3dET0F2cC1NODV4aHJwVgw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-06 04:32:20.060692+00:00 discovering original posts for: https://github.com/DataDog/datadog-agent/pull/22534
I 2024-02-06 04:32:20.062093+00:00 Original post discovery found original posts set(), mentions {'https://github.com/DataDog/datadog-agent/labels/team/agent-apm', 'https://github.com/DataDog/datadog-agent/labels/mergequeue-status%3A%20done', 'https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml', 'https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew', 'https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno', 'https://github.com/DataDog/datadog-agent/labels/qa/done', 'https://github.com/DataDog/datadog-agent/labels/qa/skip-qa'}
I 2024-02-06 04:32:20.062982+00:00 requests.head https://github.com/DataDog/datadog-agent/pull/22534 {'headers': None}
I 2024-02-06 04:32:20.665313+00:00 Received 200
I 2024-02-06 04:32:20.665636+00:00 starting posse post discovery with syndicated https://github.com/DataDog/datadog-agent/pull/22534
D 2024-02-06 04:32:20.863650+00:00 activity[content] ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: e29fe41d-17b4-488e-9dff-9072a0b27d72
Baseline: df258c125578af24c1f055797a72dd56d4fd8538
Comparison: 32dd26001789fc9c09d19ad4414d76d78105e23a
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | idle | memory utilization | -0.24 | [-0.26, -0.21] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | otel_to_otel_logs | ingress throughput | +4.19 | [+3.39, +4.99] |
| ➖ | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.39 | [+0.36, +0.42] |
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.14 | [+0.08, +0.19] |
| ➖ | process_agent_standard_check | memory utilization | +0.07 | [+0.03, +0.11] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.00 | [-0.02, +0.02] |
| ➖ | trace_agent_json | ingress throughput | -0.05 | [-0.09, -0.01] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.20 | [-0.24, -0.16] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | idle | memory utilization | -0.24 | [-0.26, -0.21] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.82 | [-3.24, -0.39] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details> => ## Bloop Bleep... Dogbot Here

# Regression Detector Results

Run ID: 53593fc8-adaa-4307-96b5-c1b1ac943a6b
Baseline: df258c125578af24c1f055797a72dd56d4fd8538
Comparison: dfc864c43777650afaf3c61ec920c5629a2e9902
Total CPUs: 7

Performance changes are noted in the **perf** column of each table:

* ✅ = significantly better comparison variant performance
* ❌ = significantly worse comparison variant performance
* ➖ = no significant change in performance

## No significant changes in experiment optimization goals

**Confidence level:** 90.00%
**Effect size tolerance:** |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

<details>
<summary><h2>
Experiments ignored for regressions
</h2></summary>

Regressions in experiments with settings containing `erratic: true` are ignored.

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-------------------|--------------------|----------|----------------|
| ➖ | idle | memory utilization | +0.23 | [+0.20, +0.26] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.07] |
</details>

<details>
<summary><h2>
Fine details of change detection per experiment
</h2></summary>

| perf | experiment | goal | Δ mean % | Δ mean % CI |
|------|-----------------------------------------|--------------------|----------|----------------|
| ➖ | tcp_syslog_to_blackhole | ingress throughput | +0.93 | [+0.87, +0.99] |
| ➖ | process_agent_standard_check | memory utilization | +0.83 | [+0.79, +0.88] |
| ➖ | process_agent_real_time_mode | memory utilization | +0.33 | [+0.30, +0.36] |
| ➖ | idle | memory utilization | +0.23 | [+0.20, +0.26] |
| ➖ | trace_agent_json | ingress throughput | +0.06 | [+0.03, +0.09] |
| ➖ | trace_agent_msgpack | ingress throughput | +0.05 | [+0.04, +0.07] |
| ➖ | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |
| ➖ | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |
| ➖ | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |
| ➖ | process_agent_standard_check_with_stats | memory utilization | -0.43 | [-0.47, -0.39] |
| ➖ | file_to_blackhole | % cpu utilization | -0.48 | [-7.03, +6.07] |
| ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.43 | [-2.85, -0.01] |
| ➖ | otel_to_otel_logs | ingress throughput | -3.00 | [-3.74, -2.26] |
</details>

<details>
<summary><h2>
Explanation
</h2></summary>

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

3. Its configuration does not mark it "erratic".
</details>
I 2024-02-06 04:32:20.864102+00:00 Response changed! Re-propagating. Original: Response(key=Key('Response', 'tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85yu14z'), activities_json=['{"id":"tag:github.com,2013:DataDog:datadog-agent:22534","url":"https://github.com/DataDog/datadog-agent/pull/22534","content":"<!--\\n* New contributors are highly encouraged to read our\\n [CONTRIBUTING](/CONTRIBUTING.md) documentation.\\n* The pull request:\\n * Should only fix one issue or add one feature at a time.\\n * Must update the test suite for the relevant functionality.\\n * Should pass all status checks before being reviewed or merged.\\n* Commit titles should be prefixed with general area of pull request\'s change.\\n\\n-->\\n### What does this PR do?\\nThis adds a new tag in TracesDropped metric to distinguish msgp Too Few Bytes errors from io EOF errors.\\n<!--\\n* A brief description of the change being made with this pull request.\\n* If the description here cannot be expressed in a succinct form, consider\\n opening multiple pull requests instead of a single one.\\n-->\\n\\n### Motivation\\nRecently we were investigating some `400` responses from the trace agent and it would have been nice on the APM Agent Dashboard to be able to visually distinguish these msgp decode ... from io EOF errors. Namely because msgp decode ... typically indicate we successfully communicated over the network but received a bad payload - while io EOF errors typically indicate network timeouts (from either us or the tracer)\\n<!--\\n* What inspired you to submit this pull request?\\n* Link any related GitHub issues or PRs here.\\n-->\\n\\n### Additional Notes\\n\\n<!--\\n* Anything else we should know when reviewing?\\n* Include benchmarking information here whenever possible.\\n* Include info about alternatives that were considered and why the proposed\\n version was chosen.\\n-->\\n\\n### Possible Drawbacks / Trade-offs\\n\\n<!--\\n* What are the possible side-effects or negative impacts of the code ... Describe how to test/QA your changes\\nModified unit test to pass is sufficient here. Also ran agent locally and send bad payload - verified the metric showed properly in the APM Agent Dashboard\\n<!--\\n* Write here in detail or link to detailed instructions on how this change can\\n be tested/QAd/validated, including any environment setup.\\n-->\\n\\n### Reviewer\'s Checklist\\n<!--\\n* Authors can use this list as a reference to ensure that there are no problems\\n during the review but the signing off is to be done by the reviewer(s).\\n\\nNote: Adding GitHub labels is only possible for contributors with write access.\\n-->\\n\\n- [ ] If known, an appropriate milestone has been selected; otherwise the `Triage` milestone is set.\\n- [ ] Use the `major_change` label if your change either has a major impact on the code ... is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.\\n- [ ] A [release note](https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno) has been added or the `changelog/no-changelog` label has been applied.\\n- [ ] Changed code ... automated tests for its functionality.\\n- [ ] Adequate QA/testing plan information is provided. Except if the `qa/skip-qa` label, with required either `qa/done` or `qa/no-code-change` labels, are applied.\\n- [ ] At least one `team/..` label has been applied, indicating the team(s) that should QA this change.\\n- [ ] If applicable, docs team has been notified or [an issue has been opened on the documentation repo](https://github.com/DataDog/documentation/issues/new)..\\n- [ ] If applicable, the `need-change/operator` and `need-change/helm` labels have been applied.\\n- [ ] If applicable, the `k8s/<min-version>` label, indicating the lowest Kubernetes version compatible with this feature.\\n- [ ] If applicable, the [config template](https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml) has been updated.\\n"}'], created=DatetimeWithNanoseconds(2024, 2, 3, 4, 25, 32, 794326, tzinfo=datetime.timezone.utc), error=[], failed=[], leased_until=None, old_response_jsons=[], original_posts=[], response_json='{"id":"tag:github.com,2013:DataDog:datadog-agent:IC_kwDOAvp-M85yu14z","url":"https://github.com/DataDog/datadog-agent/pull/22534#issuecomment-1924881971","author":{"id":"tag:github.com,2013:MDM6Qm90MzQ1NzgxMTY=","url":"https://github.com/apps/pr-commenter","displayName":"pr-commenter[bot]","objectType":"person","username":"pr-commenter[bot]","image":{"url":"https://avatars.githubusercontent.com/u/365230?v=4"}},"content":"## Bloop Bleep... Dogbot Here\\n\\n# Regression Detector Results\\n\\nRun ID: e29fe41d-17b4-488e-9dff-9072a0b27d72\\nBaseline: df258c125578af24c1f055797a72dd56d4fd8538\\nComparison: 32dd26001789fc9c09d19ad4414d76d78105e23a\\nTotal CPUs: 7\\n\\nPerformance changes are noted in the **perf** column of each table:\\n\\n* \\u2705 = significantly better comparison variant performance\\n* \\u274c = significantly worse comparison variant performance\\n* \\u2796 = no significant change in performance\\n\\n## No significant changes in experiment optimization goals\\n\\n**Confidence level:** 90.00%\\n**Effect size tolerance:** |\\u0394 mean %| \\u2265 5.00%\\n\\nThere were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.\\n\\n<details>\\n<summary><h2>\\nExperiments ignored for regressions\\n</h2></summary>\\n\\nRegressions in experiments with settings containing `erratic: true` are ignored.\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-------------------|--------------------|----------|----------------|\\n| \\u2796 | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |\\n| \\u2796 | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |\\n| \\u2796 | idle | memory utilization | -0.24 | [-0.26, -0.21] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nFine details of change detection per experiment\\n</h2></summary>\\n\\n| perf | experiment | goal | \\u0394 mean % | \\u0394 mean % CI |\\n|------|-----------------------------------------|--------------------|----------|----------------|\\n| \\u2796 | otel_to_otel_logs | ingress throughput | +4.19 | [+3.39, +4.99] |\\n| \\u2796 | file_to_blackhole | % cpu utilization | +2.21 | [-4.47, +8.88] |\\n| \\u2796 | process_agent_real_time_mode | memory utilization | +0.39 | [+0.36, +0.42] |\\n| \\u2796 | tcp_syslog_to_blackhole | ingress throughput | +0.14 | [+0.08, +0.19] |\\n| \\u2796 | process_agent_standard_check | memory utilization | +0.07 | [+0.03, +0.11] |\\n| \\u2796 | tcp_dd_logs_filter_exclude | ingress throughput | +0.00 | [-0.06, +0.06] |\\n| \\u2796 | uds_dogstatsd_to_api | ingress throughput | +0.00 | [-0.03, +0.03] |\\n| \\u2796 | trace_agent_msgpack | ingress throughput | +0.00 | [-0.02, +0.02] |\\n| \\u2796 | trace_agent_json | ingress throughput | -0.05 | [-0.09, -0.01] |\\n| \\u2796 | process_agent_standard_check_with_stats | memory utilization | -0.20 | [-0.24, -0.16] |\\n| \\u2796 | file_tree | memory utilization | -0.23 | [-0.29, -0.16] |\\n| \\u2796 | idle | memory utilization | -0.24 | [-0.26, -0.21] |\\n| \\u2796 | uds_dogstatsd_to_api_cpu | % cpu utilization | -1.82 | [-3.24, -0.39] |\\n</details>\\n\\n<details>\\n<summary><h2>\\nExplanation\\n</h2></summary>\\n\\nA regression test is an A/B test of target performance in a repeatable rig, where \\"performance\\" is measured as \\"comparison variant minus baseline variant\\" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted \\"\\u0394 mean % CI\\".\\n\\nFor each experiment, we decide whether a change in performance is a \\"regression\\" -- a change worth investigating further -- if all of the following criteria are true:\\n\\n1. Its estimated |\\u0394 mean %| \\u2265 5.00%, indicating the change is big enough to merit a closer look.\\n\\n2. Its 90.00% confidence interval \\"\\u0394 mean % CI\\" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.\\n\\n3. Its configuration does not mark it \\"erratic\\".\\n</details>","published":"2024-02-02T23:05:33+00:00","updated":"2024-02-02T23:05:33+00:00","objectType":"comment","inReplyTo":[{"url":"https://github.com/DataDog/datadog-agent/pull/22534"}]}', sent=[], skipped=[], source=Key('GitHub', 'imdario'), status='complete', type='comment', unsent=[], updated=datetime.datetime(2024, 2, 6, 4, 32, 20, 806034, tzinfo=datetime.timezone.utc), urls_to_activity=None)
I 2024-02-06 04:32:21.084674+00:00 Added propagate task projects/brid-gy/locations/us-central1/queues/propagate/tasks/0838542386487596759 with ETA None: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/propagate', 'body': b'response_key=agdicmlkLWd5cksLEghSZXNwb25zZSI9dGFnOmdpdGh1Yi5jb20sMjAxMzpEYXRhRG9nOmRhdGFkb2ctYWdlbnQ6SUNfa3dET0F2cC1NODV5dTE0egw', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}}
D 2024-02-06 04:32:21.232370+00:00 discovering original posts for: https://github.com/DataDog/datadog-agent/pull/22051
W 2024-02-06 04:32:21.234519+00:00 Found 42 original post candidates, only resolving redirects for the first 10
I 2024-02-06 04:32:21.234686+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/dependencies {'headers': {}}
I 2024-02-06 04:32:21.789760+00:00 Received 404
W 2024-02-06 04:32:21.790020+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/dependencies: https://github.com/DataDog/datadog-agent/labels/dependencies
I 2024-02-06 04:32:21.790233+00:00 requests.head https://github.com/DataDog/datadog-agent/labels/dependencies-go {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:22.623832+00:00 Received 404
W 2024-02-06 04:32:22.624103+00:00 Couldn't resolve URL https://github.com/DataDog/datadog-agent/labels/dependencies-go: https://github.com/DataDog/datadog-agent/labels/dependencies-go
I 2024-02-06 04:32:22.624306+00:00 requests.head https://github.com/shirou/gopsutil {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:23.092771+00:00 Received 200
I 2024-02-06 04:32:23.093097+00:00 requests.head https://github.com/shirou/gopsutil/releases {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:23.865477+00:00 Received 200
I 2024-02-06 04:32:23.865935+00:00 requests.head https://github.com/scop {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:24.734764+00:00 Received 200
I 2024-02-06 04:32:24.735088+00:00 requests.head https://redirect.github.com/shirou/gopsutil/pull/1570 {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:26.187250+00:00 Redirected to https://github.com/shirou/gopsutil/pull/1570
I 2024-02-06 04:32:26.187555+00:00 Received 200
D 2024-02-06 04:32:26.187665+00:00 Resolved https://redirect.github.com/shirou/gopsutil/pull/1570 to https://github.com/shirou/gopsutil/pull/1570
I 2024-02-06 04:32:26.187871+00:00 requests.head https://redirect.github.com/shirou/gopsutil/pull/1569 {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:27.294201+00:00 Redirected to https://github.com/shirou/gopsutil/pull/1569
I 2024-02-06 04:32:27.294532+00:00 Received 200
D 2024-02-06 04:32:27.294637+00:00 Resolved https://redirect.github.com/shirou/gopsutil/pull/1569 to https://github.com/shirou/gopsutil/pull/1569
I 2024-02-06 04:32:27.294837+00:00 requests.head https://redirect.github.com/shirou/gopsutil/pull/1573 {'headers': {'User-Agent': '...'}}
I 2024-02-06 04:32:28.400914+00:00 Redirected to https://github.com/shirou/gopsutil/pull/1573
I 2024-02-06 04:32:28.401223+00:00 Received 200
D 2024-02-06 04:32:28.401322+00:00 Resolved https://redirect.github.com/shirou/gopsutil/pull/1573 to https://github.com/shirou/gopsutil/pull/1573
I 2024-02-06 04:32:28.402458+00:00 Original post discovery found original posts set(), mentions {'https://redirect.github.com/shirou/gopsutil/pull/1551', 'https://redirect.github.com/shirou/gopsutil/issues/1573', 'https://redirect.github.com/shirou/gopsutil/issues/1569', 'https://github.com/shirou/gopsutil/commit/4b820ed2cad8a89a7921ff74c16043d6834978c1', 'https://github.com/shirou/gopsutil', 'https://github.com/JanDeDobbeleer', 'https://github.com/shirou/gopsutil/pull/1569', 'https://github.com/shirou/gopsutil/releases', 'https://github.com/DataDog/datadog-agent/labels/dependencies', 'https://redirect.github.com/shirou/gopsutil/pull/1536', 'https://github.com/shirou/gopsutil/commit/4870f6f119fadb622039e083a9e2280f1da415b5', 'https://github.com/shirou/gopsutil/commit/5ce87a61133b1f0a3508591dde9f6104dea799ad', 'https://redirect.github.com/shirou/gopsutil/issues/1563', 'https://github.com/keeword', 'https://github.com/shirou/gopsutil/pull/1570', 'https://github.com/scop', 'https://github.com/shirou/gopsutil/commit/362fa4b9c4058915c41458e68fd0ac297f2625cd', 'https://github.com/shirou', 'https://github.com/shirou/gopsutil/commit/08afc01d17fd284d59e4ef0d51ad976e9d706e99', 'https://redirect.github.com/shirou/gopsutil/pull/1564', 'https://github.com/shirou/gopsutil/commit/f308985abbab0da2951cdc404491eb9df5881831', 'https://redirect.github.com/shirou/gopsutil/pull/1544', 'https://github.com/DataDog/datadog-agent/labels/team/agent-apm', 'https://redirect.github.com/shirou/gopsutil/issues/1561', 'https://github.com/shirou/gopsutil/compare/v3.23.11...v3.23.12', 'https://redirect.github.com/shirou/gopsutil/issues/1564', 'https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com%2Fshirou%2Fgopsutil%2Fv3&package-manager=go_modules&previous-version=3.23.8&new-version=3.23.12', 'https://github.com/shirou/gopsutil/commit/11bc5b3970859642148dbd0fa3157c4945498a5e', 'https://github.com/shirou/gopsutil/commit/df3c7bdec0a58ca29b74457e37bc545f540eb4a0', 'https://github.com/shirou/gopsutil/pull/1573', 'https://github.com/DataDog/datadog-agent/labels/changelog/no-changelog', 'https://github.com/DataDog/datadog-agent/labels/dependencies-go', 'https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores', 'https://github.com/wolf31o2', 'https://github.com/shirou/gopsutil/compare/v3.23.10...v3.23.11', 'https://redirect.github.com/shirou/gopsutil/issues/1570', 'https://redirect.github.com/shirou/gopsutil/pull/1537', 'https://github.com/shirou/gopsutil/commit/108235a0983e3f136a707ddfd5d73b2478673636', 'https://redirect.github.com/shirou/gopsutil/pull/1561', 'https://github.com/shirou/gopsutil/compare/v3.23.8...v3.23.12', 'https://github.com/shirou/gopsutil/commit/adaeba09d9ed5b0a95d0cf7656034d8873565ff7', 'https://github.com/shirou/gopsutil/compare/v3.23.9...v3.23.10'}
I 2024-02-06 04:32:28.403181+00:00 42 mentions, pruning down to 10
I 2024-02-06 04:32:28.403410+00:00 requests.head https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com%2Fshirou%2Fgopsutil%2Fv3&package-manager=go_modules&previous-version=3.23.8&new-version=3.23.12 {'headers': {}}
I 2024-02-06 04:32:28.858952+00:00 Received 404
W 2024-02-06 04:32:28.859143+00:00 Couldn't resolve URL https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com%2Fshirou%2Fgopsutil%2Fv3&package-manager=go_modules&previous-version=3.23.8&new-version=3.23.12: https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com%2Fshirou%2Fgopsutil%2Fv3&package-manager=go_modules&previous-version=3.23.8&new-version=3.23.12
I 2024-02-06 04:32:28.860392+00:00 requests.head https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores {'headers': {}}
I 2024-02-06 04:32:29.220738+00:00 Redirected to https://docs.github.com/en/code-security/dependabot/dependabot-security-updates/about-dependabot-security-updates#about-compatibility-scores
I 2024-02-06 04:32:29.220917+00:00 Received 200
D 2024-02-06 04:32:29.221026+00:00 Resolved https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores to https://docs.github.com/en/code-security/dependabot/dependabot-security-updates/about-dependabot-security-updates#about-compatibility-scores
I 2024-02-06 04:32:29.221820+00:00 requests.head https://github.com/JanDeDobbeleer {'headers': {}}
I 2024-02-06 04:32:30.711307+00:00 Received 200
I 2024-02-06 04:32:30.711779+00:00 requests.head https://github.com/keeword {'headers': {}}
I 2024-02-06 04:32:32.386302+00:00 Received 200
I 2024-02-06 04:32:32.386798+00:00 requests.head https://github.com/shirou {'headers': {}}
I 2024-02-06 04:32:34.000129+00:00 Received 200
I 2024-02-06 04:32:34.000602+00:00 requests.head https://github.com/DataDog/datadog-agent/pull/22051 {'headers': None}
I 2024-02-06 04:32:34.880743+00:00 Received 200
I 2024-02-06 04:32:34.881022+00:00 starting posse post discovery with syndicated https://github.com/DataDog/datadog-agent/pull/22051
D 2024-02-06 04:32:35.407655+00:00 discovering original posts for: https://github.com/DataDog/datadog-agent/pull/22457
I 2024-02-06 04:32:35.408532+00:00 Original post discovery found original posts set(), mentions {'https://github.com/DataDog/datadog-agent/blob/main/pkg/config/config_template.yaml', 'https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDataDog%2Fdocumentation%2Fissues%2Fnew', 'https://github.com/DataDog/datadog-agent/blob/main/docs/dev/contributing.md#reno'}
I 2024-02-06 04:32:35.409188+00:00 requests.head https://github.com/DataDog/datadog-agent/pull/22457 {'headers': None}
I 2024-02-06 04:32:36.199130+00:00 Received 200
I 2024-02-06 04:32:36.199454+00:00 starting posse post discovery with syndicated https://github.com/DataDog/datadog-agent/pull/22457
I 2024-02-06 04:32:36.270442+00:00 requests.head https://dario.im/ {'headers': {}}
I 2024-02-06 04:32:37.661600+00:00 Redirected to https://dario.cat/
I 2024-02-06 04:32:37.681963+00:00 Received 200
D 2024-02-06 04:32:37.682234+00:00 Resolved https://dario.im/ to https://dario.cat/
D 2024-02-06 04:32:37.683245+00:00 fetching author url https://dario.cat/
I 2024-02-06 04:32:37.683380+00:00 requests.get https://dario.cat/ {'gateway': False, 'headers': {}}
I 2024-02-06 04:32:38.084727+00:00 Received 200
D 2024-02-06 04:32:38.093498+00:00 No h-feed found, fallback to top-level h-entrys.
D 2024-02-06 04:32:38.097554+00:00 posse post discovery found no relationship for https://github.com/DataDog/datadog-agent/pull/22457
I 2024-02-06 04:32:38.272806+00:00 skipping refetch h-feed. last-syndication-url None, last-refetch 2018-04-05 14:35:37.888000+00:00
I 2024-02-06 04:32:38.291592+00:00 Updating imdario (GitHub) /github/imdario : {'recent_private_posts': 0, 'last_polled': datetime.datetime(2024, 2, 6, 4, 31, 16, 28465, tzinfo=datetime.timezone.utc), 'poll_status': 'ok', 'last_activities_etag': 'Tue, 06 Feb 2024 00:15:01 GMT'}
I 2024-02-06 04:32:38.399550+00:00 Added poll task projects/brid-gy/locations/us-central1/queues/poll/tasks/62435355064527968821 with ETA 1707292411: {'app_engine_http_request': {'http_method': 'POST', 'relative_uri': '/_ah/queue/poll', 'body': b'source_key=agdicmlkLWd5chMLEgZHaXRIdWIiB2ltZGFyaW8M&last_polled=2024-02-06-04-31-16', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}}, 'schedule_time': seconds: 1707292411
}