Fix race condition in CICS JavaGateway flaky test by bm1549 · Pull Request #10793 · DataDog/dd-trace-java

bm1549 · 2026-03-10T19:46:57Z

What Does This Do

Adds TEST_WRITER.waitForTraces(1) before assertTraces(1) in the "flow without parent creates new span" test in JavaGatewayInterfaceInstrumentationTest.

Motivation

The test was occasionally failing with an assertion exception because assertTraces was called before the span was fully written to TEST_WRITER. The JavaGateway constructor throws an IOException (caught by the test), and the span finalization happens asynchronously. Without an explicit wait, there is a race condition between the test assertion and the trace writer.

This pattern (TEST_WRITER.waitForTraces(n) before assertTraces(n)) is the standard approach used across many instrumentation tests in this codebase.

Failure rate: 1x in 30 days.

Additional Notes

Only the first test ("flow without parent creates new span") needed this fix. The second test ("flow with parent span merges into parent") uses runUnderTrace which is synchronous — the span is guaranteed to be finished before the closure returns.

Jira ticket: [N/A]

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Wait for the trace to be written before asserting on it in "flow without parent creates new span". Without this, the assertion can race against the span finalization and fail spuriously. tag: no release note tag: ai generated Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

pr-commenter · 2026-03-10T20:34:14Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	brian.marks/fix-cics-gateway-flaky-test
git_commit_date	1773169596	1773171920
git_commit_sha	`cc12228`	`21bdea8`
release_version	1.61.0-SNAPSHOT~cc122288e5	1.61.0-SNAPSHOT~21bdea81fa

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773173617	1773173617
ci_job_id	1494399391	1494399391
ci_pipeline_id	101727951	101727951
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-sgfivkjb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-sgfivkjb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057715
Total [baseline] (11.009 s) : 0, 11009156
Agent [candidate] (1.066 s) : 0, 1066354
Total [candidate] (11.028 s) : 0, 11027949
section appsec
Agent [baseline] (1.247 s) : 0, 1247145
Total [baseline] (11.199 s) : 0, 11198830
Agent [candidate] (1.248 s) : 0, 1247922
Total [candidate] (11.149 s) : 0, 11149244
section iast
Agent [baseline] (1.24 s) : 0, 1239583
Total [baseline] (11.326 s) : 0, 11326047
Agent [candidate] (1.226 s) : 0, 1226207
Total [candidate] (11.322 s) : 0, 11322417
section profiling
Agent [baseline] (1.191 s) : 0, 1190617
Total [baseline] (11.117 s) : 0, 11117470
Agent [candidate] (1.183 s) : 0, 1182813
Total [candidate] (11.121 s) : 0, 11120852

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.247 s	189.43 ms (17.9%)
Agent	iast	1.24 s	181.868 ms (17.2%)
Agent	profiling	1.191 s	132.902 ms (12.6%)
Total	tracing	11.009 s	-
Total	appsec	11.199 s	189.674 ms (1.7%)
Total	iast	11.326 s	316.891 ms (2.9%)
Total	profiling	11.117 s	108.314 ms (1.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.248 s	181.568 ms (17.0%)
Agent	iast	1.226 s	159.853 ms (15.0%)
Agent	profiling	1.183 s	116.458 ms (10.9%)
Total	tracing	11.028 s	-
Total	appsec	11.149 s	121.295 ms (1.1%)
Total	iast	11.322 s	294.468 ms (2.7%)
Total	profiling	11.121 s	92.903 ms (0.8%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (625.942 ms) : 0, 625942
BytebuddyAgent [candidate] (632.777 ms) : 0, 632777
AgentMeter [baseline] (29.164 ms) : 0, 29164
AgentMeter [candidate] (29.351 ms) : 0, 29351
GlobalTracer [baseline] (256.735 ms) : 0, 256735
GlobalTracer [candidate] (258.749 ms) : 0, 258749
AppSec [baseline] (31.811 ms) : 0, 31811
AppSec [candidate] (31.725 ms) : 0, 31725
Debugger [baseline] (59.678 ms) : 0, 59678
Debugger [candidate] (59.82 ms) : 0, 59820
Remote Config [baseline] (590.587 µs) : 0, 591
Remote Config [candidate] (597.861 µs) : 0, 598
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.728 ms) : 0, 8728
Flare Poller [baseline] (7.99 ms) : 0, 7990
Flare Poller [candidate] (7.221 ms) : 0, 7221
section appsec
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (657.855 ms) : 0, 657855
BytebuddyAgent [candidate] (657.236 ms) : 0, 657236
AgentMeter [baseline] (12.067 ms) : 0, 12067
AgentMeter [candidate] (12.032 ms) : 0, 12032
GlobalTracer [baseline] (258.43 ms) : 0, 258430
GlobalTracer [candidate] (259.232 ms) : 0, 259232
IAST [baseline] (23.926 ms) : 0, 23926
IAST [candidate] (24.125 ms) : 0, 24125
AppSec [baseline] (177.643 ms) : 0, 177643
AppSec [candidate] (178.401 ms) : 0, 178401
Debugger [baseline] (66.304 ms) : 0, 66304
Debugger [candidate] (65.37 ms) : 0, 65370
Remote Config [baseline] (582.525 µs) : 0, 583
Remote Config [candidate] (573.352 µs) : 0, 573
Telemetry [baseline] (9.177 ms) : 0, 9177
Telemetry [candidate] (9.856 ms) : 0, 9856
Flare Poller [baseline] (3.646 ms) : 0, 3646
Flare Poller [candidate] (3.593 ms) : 0, 3593
section iast
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (806.045 ms) : 0, 806045
BytebuddyAgent [candidate] (795.147 ms) : 0, 795147
AgentMeter [baseline] (11.446 ms) : 0, 11446
AgentMeter [candidate] (11.333 ms) : 0, 11333
GlobalTracer [baseline] (248.561 ms) : 0, 248561
GlobalTracer [candidate] (247.388 ms) : 0, 247388
IAST [baseline] (25.279 ms) : 0, 25279
IAST [candidate] (25.102 ms) : 0, 25102
AppSec [baseline] (26.584 ms) : 0, 26584
AppSec [candidate] (27.264 ms) : 0, 27264
Debugger [baseline] (64.428 ms) : 0, 64428
Debugger [candidate] (62.613 ms) : 0, 62613
Remote Config [baseline] (532.232 µs) : 0, 532
Remote Config [candidate] (525.718 µs) : 0, 526
Telemetry [baseline] (14.361 ms) : 0, 14361
Telemetry [candidate] (14.69 ms) : 0, 14690
Flare Poller [baseline] (4.713 ms) : 0, 4713
Flare Poller [candidate] (4.909 ms) : 0, 4909
section profiling
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (687.922 ms) : 0, 687922
BytebuddyAgent [candidate] (682.882 ms) : 0, 682882
AgentMeter [baseline] (8.634 ms) : 0, 8634
AgentMeter [candidate] (8.591 ms) : 0, 8591
GlobalTracer [baseline] (216.602 ms) : 0, 216602
GlobalTracer [candidate] (215.5 ms) : 0, 215500
AppSec [baseline] (32.246 ms) : 0, 32246
AppSec [candidate] (31.877 ms) : 0, 31877
Debugger [baseline] (65.668 ms) : 0, 65668
Debugger [candidate] (62.958 ms) : 0, 62958
Remote Config [baseline] (591.946 µs) : 0, 592
Remote Config [candidate] (581.474 µs) : 0, 581
Telemetry [baseline] (8.276 ms) : 0, 8276
Telemetry [candidate] (9.798 ms) : 0, 9798
Flare Poller [baseline] (3.533 ms) : 0, 3533
Flare Poller [candidate] (4.288 ms) : 0, 4288
ProfilingAgent [baseline] (94.352 ms) : 0, 94352
ProfilingAgent [candidate] (94.397 ms) : 0, 94397
Profiling [baseline] (94.915 ms) : 0, 94915
Profiling [candidate] (94.966 ms) : 0, 94966

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059511
Total [baseline] (8.823 s) : 0, 8822827
Agent [candidate] (1.061 s) : 0, 1060689
Total [candidate] (8.818 s) : 0, 8818303
section iast
Agent [baseline] (1.227 s) : 0, 1226638
Total [baseline] (9.615 s) : 0, 9614637
Agent [candidate] (1.23 s) : 0, 1229618
Total [candidate] (9.546 s) : 0, 9546333

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.227 s	167.126 ms (15.8%)
Total	tracing	8.823 s	-
Total	iast	9.615 s	791.81 ms (9.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.061 s	-
Agent	iast	1.23 s	168.929 ms (15.9%)
Total	tracing	8.818 s	-
Total	iast	9.546 s	728.03 ms (8.3%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (629.277 ms) : 0, 629277
BytebuddyAgent [candidate] (629.684 ms) : 0, 629684
AgentMeter [baseline] (29.093 ms) : 0, 29093
AgentMeter [candidate] (29.068 ms) : 0, 29068
GlobalTracer [baseline] (256.948 ms) : 0, 256948
GlobalTracer [candidate] (257.916 ms) : 0, 257916
AppSec [baseline] (31.589 ms) : 0, 31589
AppSec [candidate] (31.566 ms) : 0, 31566
Debugger [baseline] (58.64 ms) : 0, 58640
Debugger [candidate] (58.645 ms) : 0, 58645
Remote Config [baseline] (607.006 µs) : 0, 607
Remote Config [candidate] (590.803 µs) : 0, 591
Telemetry [baseline] (8.839 ms) : 0, 8839
Telemetry [candidate] (8.735 ms) : 0, 8735
Flare Poller [baseline] (7.27 ms) : 0, 7270
Flare Poller [candidate] (7.132 ms) : 0, 7132
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (795.371 ms) : 0, 795371
BytebuddyAgent [candidate] (798.123 ms) : 0, 798123
AgentMeter [baseline] (11.283 ms) : 0, 11283
AgentMeter [candidate] (11.327 ms) : 0, 11327
GlobalTracer [baseline] (247.41 ms) : 0, 247410
GlobalTracer [candidate] (248.084 ms) : 0, 248084
AppSec [baseline] (27.272 ms) : 0, 27272
AppSec [candidate] (26.509 ms) : 0, 26509
Debugger [baseline] (62.317 ms) : 0, 62317
Debugger [candidate] (62.742 ms) : 0, 62742
Remote Config [baseline] (537.507 µs) : 0, 538
Remote Config [candidate] (526.542 µs) : 0, 527
Telemetry [baseline] (15.364 ms) : 0, 15364
Telemetry [candidate] (14.809 ms) : 0, 14809
Flare Poller [baseline] (4.68 ms) : 0, 4680
Flare Poller [candidate] (4.894 ms) : 0, 4894
IAST [baseline] (25.195 ms) : 0, 25195
IAST [candidate] (25.246 ms) : 0, 25246

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	brian.marks/fix-cics-gateway-flaky-test
git_commit_date	1773169596	1773171920
git_commit_sha	`cc12228`	`21bdea8`
release_version	1.61.0-SNAPSHOT~cc122288e5	1.61.0-SNAPSHOT~21bdea81fa

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773174318	1773174318
ci_job_id	1494399392	1494399392
ci_pipeline_id	101727951	101727951
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-5-oi307ib5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-5-oi307ib5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+66.274µs; +171.608µs] or [+2.364%; +6.121%]	same [-40.948µs; +432.037µs] or [-0.518%; +5.468%]	unstable [-170.443op/s; +112.880op/s] or [-13.343%; +8.836%]	2.923ms	8.097ms	1248.656op/s	2.804ms	7.902ms	1277.438op/s
scenario:load:petclinic:tracing:high_load	worse [+0.762ms; +1.541ms] or [+4.356%; +8.803%]	unsure [+0.438ms; +1.874ms] or [+1.529%; +6.539%]	unstable [-42.421op/s; +10.921op/s] or [-16.180%; +4.165%]	18.657ms	29.820ms	246.438op/s	17.505ms	28.664ms	262.188op/s
scenario:load:petclinic:profiling:high_load	better [-3.171ms; -2.409ms] or [-15.156%; -11.513%]	better [-4.512ms; -2.645ms] or [-13.660%; -8.006%]	unstable [+4.638op/s; +54.425op/s] or [+2.088%; +24.509%]	18.133ms	29.454ms	251.594op/s	20.923ms	33.033ms	222.062op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.713ms; +2.074ms] or [+4.200%; +12.224%]	unstable [+0.172ms; +3.638ms] or [+0.595%; +12.569%]	unstable [-47.638op/s; +9.451op/s] or [-17.863%; +3.544%]	18.363ms	30.848ms	247.594op/s	16.970ms	28.943ms	266.688op/s
scenario:load:petclinic:iast:high_load	better [-973.832µs; -397.614µs] or [-5.225%; -2.133%]	unsure [-1558.754µs; -193.392µs] or [-5.195%; -0.645%]	unstable [-16.753op/s; +35.566op/s] or [-6.793%; +14.421%]	17.953ms	29.129ms	256.031op/s	18.638ms	30.005ms	246.625op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.492 ms) : 17313, 17671
.   : milestone, 17492,
appsec (18.942 ms) : 18752, 19132
.   : milestone, 18942,
code_origins (18.004 ms) : 17822, 18186
.   : milestone, 18004,
iast (18.923 ms) : 18736, 19111
.   : milestone, 18923,
profiling (21.031 ms) : 20813, 21249
.   : milestone, 21031,
tracing (17.797 ms) : 17621, 17974
.   : milestone, 17797,
section candidate
no_agent (18.854 ms) : 18660, 19049
.   : milestone, 18854,
appsec (18.665 ms) : 18478, 18853
.   : milestone, 18665,
code_origins (18.722 ms) : 18535, 18909
.   : milestone, 18722,
iast (18.226 ms) : 18045, 18407
.   : milestone, 18226,
profiling (18.548 ms) : 18364, 18732
.   : milestone, 18548,
tracing (18.945 ms) : 18756, 19133
.   : milestone, 18945,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.492 ms [17.313 ms, 17.671 ms]	-
appsec	18.942 ms [18.752 ms, 19.132 ms]	1.45 ms (8.3%)
code_origins	18.004 ms [17.822 ms, 18.186 ms]	512.42 µs (2.9%)
iast	18.923 ms [18.736 ms, 19.111 ms]	1.431 ms (8.2%)
profiling	21.031 ms [20.813 ms, 21.249 ms]	3.539 ms (20.2%)
tracing	17.797 ms [17.621 ms, 17.974 ms]	305.091 µs (1.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.854 ms [18.66 ms, 19.049 ms]	-
appsec	18.665 ms [18.478 ms, 18.853 ms]	-189.135 µs (-1.0%)
code_origins	18.722 ms [18.535 ms, 18.909 ms]	-132.452 µs (-0.7%)
iast	18.226 ms [18.045 ms, 18.407 ms]	-628.028 µs (-3.3%)
profiling	18.548 ms [18.364 ms, 18.732 ms]	-306.281 µs (-1.6%)
tracing	18.945 ms [18.756 ms, 19.133 ms]	90.209 µs (0.5%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1181, 1204
.   : milestone, 1193,
iast (3.124 ms) : 3079, 3169
.   : milestone, 3124,
iast_FULL (5.922 ms) : 5863, 5982
.   : milestone, 5922,
iast_GLOBAL (3.59 ms) : 3525, 3656
.   : milestone, 3590,
profiling (2.183 ms) : 2160, 2206
.   : milestone, 2183,
tracing (1.931 ms) : 1913, 1949
.   : milestone, 1931,
section candidate
no_agent (1.195 ms) : 1183, 1206
.   : milestone, 1195,
iast (3.18 ms) : 3139, 3222
.   : milestone, 3180,
iast_FULL (6.076 ms) : 6013, 6139
.   : milestone, 6076,
iast_GLOBAL (3.674 ms) : 3617, 3731
.   : milestone, 3674,
profiling (2.138 ms) : 2118, 2159
.   : milestone, 2138,
tracing (1.802 ms) : 1787, 1817
.   : milestone, 1802,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.193 ms [1.181 ms, 1.204 ms]	-
iast	3.124 ms [3.079 ms, 3.169 ms]	1.931 ms (161.9%)
iast_FULL	5.922 ms [5.863 ms, 5.982 ms]	4.729 ms (396.5%)
iast_GLOBAL	3.59 ms [3.525 ms, 3.656 ms]	2.397 ms (201.0%)
profiling	2.183 ms [2.16 ms, 2.206 ms]	990.389 µs (83.0%)
tracing	1.931 ms [1.913 ms, 1.949 ms]	738.1 µs (61.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.195 ms [1.183 ms, 1.206 ms]	-
iast	3.18 ms [3.139 ms, 3.222 ms]	1.985 ms (166.2%)
iast_FULL	6.076 ms [6.013 ms, 6.139 ms]	4.881 ms (408.5%)
iast_GLOBAL	3.674 ms [3.617 ms, 3.731 ms]	2.479 ms (207.5%)
profiling	2.138 ms [2.118 ms, 2.159 ms]	943.611 µs (79.0%)
tracing	1.802 ms [1.787 ms, 1.817 ms]	607.04 µs (50.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	brian.marks/fix-cics-gateway-flaky-test
git_commit_date	1773169596	1773171920
git_commit_sha	`cc12228`	`21bdea8`
release_version	1.61.0-SNAPSHOT~cc122288e5	1.61.0-SNAPSHOT~21bdea81fa

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1773173865	1773173865
ci_job_id	1494399394	1494399394
ci_pipeline_id	101727951	101727951
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-6-naw2k5jr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-6-naw2k5jr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.565 ms) : 2507, 2623
.   : milestone, 2565,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.296 ms) : 2227, 2366
.   : milestone, 2296,
profiling (2.096 ms) : 2039, 2152
.   : milestone, 2096,
tracing (2.067 ms) : 2013, 2121
.   : milestone, 2067,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.503 ms) : 2448, 2558
.   : milestone, 2503,
iast (2.245 ms) : 2176, 2314
.   : milestone, 2245,
iast_GLOBAL (2.299 ms) : 2229, 2368
.   : milestone, 2299,
profiling (2.522 ms) : 2353, 2691
.   : milestone, 2522,
tracing (2.059 ms) : 2005, 2112
.   : milestone, 2059,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.459 ms, 1.482 ms]	-
appsec	2.565 ms [2.507 ms, 2.623 ms]	1.094 ms (74.4%)
iast	2.252 ms [2.183 ms, 2.321 ms]	780.942 µs (53.1%)
iast_GLOBAL	2.296 ms [2.227 ms, 2.366 ms]	825.372 µs (56.1%)
profiling	2.096 ms [2.039 ms, 2.152 ms]	624.924 µs (42.5%)
tracing	2.067 ms [2.013 ms, 2.121 ms]	596.258 µs (40.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	2.503 ms [2.448 ms, 2.558 ms]	1.032 ms (70.1%)
iast	2.245 ms [2.176 ms, 2.314 ms]	773.617 µs (52.6%)
iast_GLOBAL	2.299 ms [2.229 ms, 2.368 ms]	827.623 µs (56.3%)
profiling	2.522 ms [2.353 ms, 2.691 ms]	1.051 ms (71.4%)
tracing	2.059 ms [2.005 ms, 2.112 ms]	587.825 µs (40.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~21bdea81fa, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.239 s) : 15239000, 15239000
.   : milestone, 15239000,
appsec (14.7 s) : 14700000, 14700000
.   : milestone, 14700000,
iast (18.474 s) : 18474000, 18474000
.   : milestone, 18474000,
iast_GLOBAL (17.873 s) : 17873000, 17873000
.   : milestone, 17873000,
profiling (14.832 s) : 14832000, 14832000
.   : milestone, 14832000,
tracing (15.209 s) : 15209000, 15209000
.   : milestone, 15209000,
section candidate
no_agent (14.864 s) : 14864000, 14864000
.   : milestone, 14864000,
appsec (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
iast (18.003 s) : 18003000, 18003000
.   : milestone, 18003000,
iast_GLOBAL (17.816 s) : 17816000, 17816000
.   : milestone, 17816000,
profiling (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
tracing (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.239 s [15.239 s, 15.239 s]	-
appsec	14.7 s [14.7 s, 14.7 s]	-539.0 ms (-3.5%)
iast	18.474 s [18.474 s, 18.474 s]	3.235 s (21.2%)
iast_GLOBAL	17.873 s [17.873 s, 17.873 s]	2.634 s (17.3%)
profiling	14.832 s [14.832 s, 14.832 s]	-407.0 ms (-2.7%)
tracing	15.209 s [15.209 s, 15.209 s]	-30.0 ms (-0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.864 s [14.864 s, 14.864 s]	-
appsec	15.082 s [15.082 s, 15.082 s]	218.0 ms (1.5%)
iast	18.003 s [18.003 s, 18.003 s]	3.139 s (21.1%)
iast_GLOBAL	17.816 s [17.816 s, 17.816 s]	2.952 s (19.9%)
profiling	15.266 s [15.266 s, 15.266 s]	402.0 ms (2.7%)
tracing	15.03 s [15.03 s, 15.03 s]	166.0 ms (1.1%)

bm1549 added tag: flaky test Flaky tests tag: ai generated Largely based on code generated by an AI or LLM tag: no release notes Changes to exclude from release notes labels Mar 10, 2026

bm1549 marked this pull request as ready for review March 10, 2026 20:43

bm1549 requested a review from a team as a code owner March 10, 2026 20:43

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix race condition in CICS JavaGateway flaky test#10793

Fix race condition in CICS JavaGateway flaky test#10793
bm1549 wants to merge 1 commit intomasterfrom
brian.marks/fix-cics-gateway-flaky-test

bm1549 commented Mar 10, 2026

Uh oh!

pr-commenter bot commented Mar 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

bm1549 commented Mar 10, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 10, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant