Skip to content

Create final status tag on test events#10528

Open
daniel-mohedano wants to merge 3 commits intomasterfrom
daniel.mohedano/final-status
Open

Create final status tag on test events#10528
daniel-mohedano wants to merge 3 commits intomasterfrom
daniel.mohedano/final-status

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Feb 5, 2026 •
edited by atlassian bot
Loading

What Does This Do

  • Adds a @test.final_status tag to indicate the final status for the test actually reported to the testing framework, as opposed to Datadog. It's possible values are:
    • pass if the test passed, passed after retries, or its failure was suppressed to avoid failing the test process.
    • skip if the test was skipped.
    • fail if the test failed the build.
  • The tag is reported only on the final retry of a test, or in its only execution if it is not retried by any of DD's advanced features.

Motivation

This information will provide better context to users on whether a certain test failed or not their build, without having to infer it from other tags + understanding the behavior of our advanced features. This tag will allow them to easily track actual test failures in their pipelines.

Additional Notes

Note

Given the big amount of changes due to test fixtures updates, the commits haven been organized to ease the review process.

  • Test fixtures have been updated to consider this new tag as well.

Contributor Checklist

Jira ticket: SDTEST-2983

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Feb 5, 2026
@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 57.14
agentEvpProxy 56.62

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 38.57
agentless 37.47
agentlessCodeCoverage 44.62
agentlessLineCoverage 76.52

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 8.42
agentless 12.22
agentlessCodeCoverage 19.59

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 22.91
agentless 19.02
agentlessCodeCoverage 21.36
agentlessLineCoverage 30.46

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 90.93
agentless 83.77
agentlessCodeCoverage 98.83
agentlessLineCoverage 115.32

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 13.11
agentless 12.77
agentlessCodeCoverage 16.02
agentlessLineCoverage 19.47

@pr-commenter
Copy link

pr-commenter bot commented Feb 5, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770285118 1770296666
git_commit_sha a89bfc4 46cac19
release_version 1.60.0-SNAPSHOT~a89bfc4d10 1.60.0-SNAPSHOT~46cac1925d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770298536 1770298536
ci_job_id 1403768320 1403768320
ci_pipeline_id 94856048 94856048
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lcf6xf8w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lcf6xf8w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064536
Total [baseline] (8.751 s) : 0, 8751169
Agent [candidate] (1.068 s) : 0, 1068439
Total [candidate] (8.75 s) : 0, 8749919
section iast
Agent [baseline] (1.233 s) : 0, 1233064
Total [baseline] (9.431 s) : 0, 9431076
Agent [candidate] (1.233 s) : 0, 1232934
Total [candidate] (9.405 s) : 0, 9404791
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.233 s 168.529 ms (15.8%)
Total tracing 8.751 s -
Total iast 9.431 s 679.907 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.233 s 164.496 ms (15.4%)
Total tracing 8.75 s -
Total iast 9.405 s 654.872 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (628.088 ms) : 0, 628088
BytebuddyAgent [candidate] (630.343 ms) : 0, 630343
AgentMeter [baseline] (28.799 ms) : 0, 28799
AgentMeter [candidate] (28.903 ms) : 0, 28903
GlobalTracer [baseline] (258.069 ms) : 0, 258069
GlobalTracer [candidate] (258.831 ms) : 0, 258831
AppSec [baseline] (32.84 ms) : 0, 32840
AppSec [candidate] (32.985 ms) : 0, 32985
Debugger [baseline] (61.71 ms) : 0, 61710
Debugger [candidate] (60.546 ms) : 0, 60546
Remote Config [baseline] (606.378 µs) : 0, 606
Remote Config [candidate] (623.859 µs) : 0, 624
Telemetry [baseline] (12.337 ms) : 0, 12337
Telemetry [candidate] (13.22 ms) : 0, 13220
Flare Poller [baseline] (5.446 ms) : 0, 5446
Flare Poller [candidate] (6.334 ms) : 0, 6334
section iast
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (796.706 ms) : 0, 796706
BytebuddyAgent [candidate] (796.413 ms) : 0, 796413
AgentMeter [baseline] (11.31 ms) : 0, 11310
AgentMeter [candidate] (11.329 ms) : 0, 11329
GlobalTracer [baseline] (248.232 ms) : 0, 248232
GlobalTracer [candidate] (248.279 ms) : 0, 248279
AppSec [baseline] (31.588 ms) : 0, 31588
AppSec [candidate] (32.314 ms) : 0, 32314
Debugger [baseline] (68.691 ms) : 0, 68691
Debugger [candidate] (68.173 ms) : 0, 68173
Remote Config [baseline] (550.496 µs) : 0, 550
Remote Config [candidate] (553.424 µs) : 0, 553
Telemetry [baseline] (8.731 ms) : 0, 8731
Telemetry [candidate] (8.707 ms) : 0, 8707
Flare Poller [baseline] (3.503 ms) : 0, 3503
Flare Poller [candidate] (3.502 ms) : 0, 3502
IAST [baseline] (27.157 ms) : 0, 27157
IAST [candidate] (27.029 ms) : 0, 27029
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068823
Total [baseline] (10.862 s) : 0, 10861901
Agent [candidate] (1.074 s) : 0, 1073779
Total [candidate] (10.82 s) : 0, 10820408
section appsec
Agent [baseline] (1.25 s) : 0, 1249817
Total [baseline] (11.108 s) : 0, 11108487
Agent [candidate] (1.251 s) : 0, 1250660
Total [candidate] (11.035 s) : 0, 11035371
section iast
Agent [baseline] (1.234 s) : 0, 1234093
Total [baseline] (11.176 s) : 0, 11176092
Agent [candidate] (1.234 s) : 0, 1234263
Total [candidate] (11.192 s) : 0, 11192109
section profiling
Agent [baseline] (1.192 s) : 0, 1192140
Total [baseline] (11.081 s) : 0, 11080815
Agent [candidate] (1.203 s) : 0, 1202577
Total [candidate] (11.024 s) : 0, 11024033
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.25 s 180.994 ms (16.9%)
Agent iast 1.234 s 165.27 ms (15.5%)
Agent profiling 1.192 s 123.317 ms (11.5%)
Total tracing 10.862 s -
Total appsec 11.108 s 246.586 ms (2.3%)
Total iast 11.176 s 314.191 ms (2.9%)
Total profiling 11.081 s 218.913 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.251 s 176.881 ms (16.5%)
Agent iast 1.234 s 160.483 ms (14.9%)
Agent profiling 1.203 s 128.798 ms (12.0%)
Total tracing 10.82 s -
Total appsec 11.035 s 214.963 ms (2.0%)
Total iast 11.192 s 371.7 ms (3.4%)
Total profiling 11.024 s 203.624 ms (1.9%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (630.52 ms) : 0, 630520
BytebuddyAgent [candidate] (634.12 ms) : 0, 634120
AgentMeter [baseline] (28.862 ms) : 0, 28862
AgentMeter [candidate] (29.083 ms) : 0, 29083
GlobalTracer [baseline] (258.284 ms) : 0, 258284
GlobalTracer [candidate] (260.135 ms) : 0, 260135
AppSec [baseline] (32.763 ms) : 0, 32763
AppSec [candidate] (33.072 ms) : 0, 33072
Debugger [baseline] (62.722 ms) : 0, 62722
Debugger [candidate] (63.187 ms) : 0, 63187
Remote Config [baseline] (606.683 µs) : 0, 607
Remote Config [candidate] (619.419 µs) : 0, 619
Telemetry [baseline] (13.69 ms) : 0, 13690
Telemetry [candidate] (13.026 ms) : 0, 13026
Flare Poller [baseline] (4.597 ms) : 0, 4597
Flare Poller [candidate] (3.789 ms) : 0, 3789
section appsec
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (663.78 ms) : 0, 663780
BytebuddyAgent [candidate] (664.676 ms) : 0, 664676
AgentMeter [baseline] (11.999 ms) : 0, 11999
AgentMeter [candidate] (11.989 ms) : 0, 11989
GlobalTracer [baseline] (260.522 ms) : 0, 260522
GlobalTracer [candidate] (261.006 ms) : 0, 261006
IAST [baseline] (25.551 ms) : 0, 25551
IAST [candidate] (25.522 ms) : 0, 25522
AppSec [baseline] (169.51 ms) : 0, 169510
AppSec [candidate] (168.78 ms) : 0, 168780
Debugger [baseline] (67.942 ms) : 0, 67942
Debugger [candidate] (68.142 ms) : 0, 68142
Remote Config [baseline] (682.461 µs) : 0, 682
Remote Config [candidate] (689.841 µs) : 0, 690
Telemetry [baseline] (9.258 ms) : 0, 9258
Telemetry [candidate] (9.253 ms) : 0, 9253
Flare Poller [baseline] (3.696 ms) : 0, 3696
Flare Poller [candidate] (3.743 ms) : 0, 3743
section iast
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (797.25 ms) : 0, 797250
BytebuddyAgent [candidate] (796.916 ms) : 0, 796916
AgentMeter [baseline] (11.273 ms) : 0, 11273
AgentMeter [candidate] (11.273 ms) : 0, 11273
GlobalTracer [baseline] (248.414 ms) : 0, 248414
GlobalTracer [candidate] (248.681 ms) : 0, 248681
IAST [baseline] (27.003 ms) : 0, 27003
IAST [candidate] (26.857 ms) : 0, 26857
AppSec [baseline] (34.132 ms) : 0, 34132
AppSec [candidate] (31.552 ms) : 0, 31552
Debugger [baseline] (66.75 ms) : 0, 66750
Debugger [candidate] (69.68 ms) : 0, 69680
Remote Config [baseline] (544.825 µs) : 0, 545
Remote Config [candidate] (540.912 µs) : 0, 541
Telemetry [baseline] (8.705 ms) : 0, 8705
Telemetry [candidate] (8.697 ms) : 0, 8697
Flare Poller [baseline] (3.424 ms) : 0, 3424
Flare Poller [candidate] (3.495 ms) : 0, 3495
section profiling
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (682.712 ms) : 0, 682712
BytebuddyAgent [candidate] (690.129 ms) : 0, 690129
AgentMeter [baseline] (8.82 ms) : 0, 8820
AgentMeter [candidate] (8.852 ms) : 0, 8852
GlobalTracer [baseline] (216.409 ms) : 0, 216409
GlobalTracer [candidate] (218.13 ms) : 0, 218130
AppSec [baseline] (32.468 ms) : 0, 32468
AppSec [candidate] (32.637 ms) : 0, 32637
Debugger [baseline] (67.393 ms) : 0, 67393
Debugger [candidate] (67.997 ms) : 0, 67997
Remote Config [baseline] (600.746 µs) : 0, 601
Remote Config [candidate] (602.769 µs) : 0, 603
Telemetry [baseline] (8.845 ms) : 0, 8845
Telemetry [candidate] (8.864 ms) : 0, 8864
Flare Poller [baseline] (3.762 ms) : 0, 3762
Flare Poller [candidate] (3.795 ms) : 0, 3795
ProfilingAgent [baseline] (100.009 ms) : 0, 100009
ProfilingAgent [candidate] (99.808 ms) : 0, 99808
Profiling [baseline] (100.577 ms) : 0, 100577
Profiling [candidate] (100.395 ms) : 0, 100395
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770285118 1770296666
git_commit_sha a89bfc4 46cac19
release_version 1.60.0-SNAPSHOT~a89bfc4d10 1.60.0-SNAPSHOT~46cac1925d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770299029 1770299029
ci_job_id 1403768323 1403768323
ci_pipeline_id 94856048 94856048
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-yd6nw9v7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-yd6nw9v7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-1266.713µs; -522.972µs] or [-7.065%; -2.917%]		 unsure
[-1.640ms; -0.376ms] or [-5.631%; -1.292%]		 unstable
[-14.634op/s; +39.134op/s] or [-5.721%; +15.300%]		 17.035ms 28.118ms 268.031op/s 17.929ms 29.126ms 255.781op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.466ms; +1.997ms] or [+2.579%; +11.043%]		 unstable
[-0.390ms; +2.819ms] or [-1.286%; +9.289%]		 unstable
[-41.612op/s; +12.550op/s] or [-16.583%; +5.001%]		 19.317ms 31.557ms 236.406op/s 18.086ms 30.343ms 250.938op/s
scenario:load:petclinic:profiling:high_load worse
[+379.752µs; +877.745µs] or [+2.099%; +4.852%]		 unsure
[+0.255ms; +1.883ms] or [+0.880%; +6.492%]		 unstable
[-32.981op/s; +18.919op/s] or [-13.059%; +7.491%]		 18.718ms 30.068ms 245.531op/s 18.090ms 28.999ms 252.562op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.181 ms) : 3140, 3223
.   : milestone, 3181,
iast_FULL (6.027 ms) : 5967, 6088
.   : milestone, 6027,
iast_GLOBAL (3.573 ms) : 3511, 3636
.   : milestone, 3573,
profiling (2.133 ms) : 2113, 2153
.   : milestone, 2133,
tracing (1.791 ms) : 1776, 1806
.   : milestone, 1791,
section candidate
no_agent (1.176 ms) : 1165, 1188
.   : milestone, 1176,
iast (3.22 ms) : 3180, 3261
.   : milestone, 3220,
iast_FULL (5.898 ms) : 5839, 5957
.   : milestone, 5898,
iast_GLOBAL (3.544 ms) : 3492, 3597
.   : milestone, 3544,
profiling (2.018 ms) : 2001, 2036
.   : milestone, 2018,
tracing (1.77 ms) : 1755, 1786
.   : milestone, 1770,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.181 ms [3.14 ms, 3.223 ms] 2.001 ms (169.4%)
iast_FULL 6.027 ms [5.967 ms, 6.088 ms] 4.847 ms (410.5%)
iast_GLOBAL 3.573 ms [3.511 ms, 3.636 ms] 2.393 ms (202.6%)
profiling 2.133 ms [2.113 ms, 2.153 ms] 952.357 µs (80.7%)
tracing 1.791 ms [1.776 ms, 1.806 ms] 610.592 µs (51.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.165 ms, 1.188 ms] -
iast 3.22 ms [3.18 ms, 3.261 ms] 2.044 ms (173.8%)
iast_FULL 5.898 ms [5.839 ms, 5.957 ms] 4.721 ms (401.4%)
iast_GLOBAL 3.544 ms [3.492 ms, 3.597 ms] 2.368 ms (201.3%)
profiling 2.018 ms [2.001 ms, 2.036 ms] 841.908 µs (71.6%)
tracing 1.77 ms [1.755 ms, 1.786 ms] 594.196 µs (50.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.6 ms) : 18408, 18793
.   : milestone, 18600,
appsec (18.967 ms) : 18774, 19159
.   : milestone, 18967,
code_origins (17.71 ms) : 17534, 17886
.   : milestone, 17710,
iast (18.245 ms) : 18064, 18425
.   : milestone, 18245,
profiling (18.479 ms) : 18298, 18661
.   : milestone, 18479,
tracing (17.965 ms) : 17786, 18144
.   : milestone, 17965,
section candidate
no_agent (19.745 ms) : 19541, 19949
.   : milestone, 19745,
appsec (18.875 ms) : 18681, 19068
.   : milestone, 18875,
code_origins (17.688 ms) : 17515, 17862
.   : milestone, 17688,
iast (17.407 ms) : 17234, 17580
.   : milestone, 17407,
profiling (19.007 ms) : 18819, 19195
.   : milestone, 19007,
tracing (17.563 ms) : 17388, 17738
.   : milestone, 17563,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.6 ms [18.408 ms, 18.793 ms] -
appsec 18.967 ms [18.774 ms, 19.159 ms] 366.126 µs (2.0%)
code_origins 17.71 ms [17.534 ms, 17.886 ms] -890.176 µs (-4.8%)
iast 18.245 ms [18.064 ms, 18.425 ms] -355.524 µs (-1.9%)
profiling 18.479 ms [18.298 ms, 18.661 ms] -121.336 µs (-0.7%)
tracing 17.965 ms [17.786 ms, 18.144 ms] -635.349 µs (-3.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.745 ms [19.541 ms, 19.949 ms] -
appsec 18.875 ms [18.681 ms, 19.068 ms] -869.93 µs (-4.4%)
code_origins 17.688 ms [17.515 ms, 17.862 ms] -2.056 ms (-10.4%)
iast 17.407 ms [17.234 ms, 17.58 ms] -2.338 ms (-11.8%)
profiling 19.007 ms [18.819 ms, 19.195 ms] -737.644 µs (-3.7%)
tracing 17.563 ms [17.388 ms, 17.738 ms] -2.182 ms (-11.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770285118 1770296666
git_commit_sha a89bfc4 46cac19
release_version 1.60.0-SNAPSHOT~a89bfc4d10 1.60.0-SNAPSHOT~46cac1925d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770298771 1770298771
ci_job_id 1403768326 1403768326
ci_pipeline_id 94856048 94856048
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2npr2b2e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2npr2b2e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.681 ms) : 3465, 3897
.   : milestone, 3681,
iast (2.247 ms) : 2178, 2315
.   : milestone, 2247,
iast_GLOBAL (2.29 ms) : 2221, 2359
.   : milestone, 2290,
profiling (2.068 ms) : 2014, 2123
.   : milestone, 2068,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.699 ms) : 3484, 3915
.   : milestone, 3699,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.299 ms) : 2230, 2368
.   : milestone, 2299,
profiling (2.083 ms) : 2027, 2139
.   : milestone, 2083,
tracing (2.055 ms) : 2001, 2108
.   : milestone, 2055,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.681 ms [3.465 ms, 3.897 ms] 2.204 ms (149.3%)
iast 2.247 ms [2.178 ms, 2.315 ms] 769.715 µs (52.1%)
iast_GLOBAL 2.29 ms [2.221 ms, 2.359 ms] 813.143 µs (55.1%)
profiling 2.068 ms [2.014 ms, 2.123 ms] 591.605 µs (40.1%)
tracing 2.066 ms [2.013 ms, 2.12 ms] 589.56 µs (39.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.699 ms [3.484 ms, 3.915 ms] 2.227 ms (151.2%)
iast 2.252 ms [2.183 ms, 2.321 ms] 779.174 µs (52.9%)
iast_GLOBAL 2.299 ms [2.23 ms, 2.368 ms] 826.141 µs (56.1%)
profiling 2.083 ms [2.027 ms, 2.139 ms] 609.955 µs (41.4%)
tracing 2.055 ms [2.001 ms, 2.108 ms] 581.688 µs (39.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~46cac1925d, baseline=1.60.0-SNAPSHOT~a89bfc4d10
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.284 s) : 15284000, 15284000
.   : milestone, 15284000,
appsec (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
iast (18.386 s) : 18386000, 18386000
.   : milestone, 18386000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
.   : milestone, 17930000,
profiling (14.929 s) : 14929000, 14929000
.   : milestone, 14929000,
tracing (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
section candidate
no_agent (15.752 s) : 15752000, 15752000
.   : milestone, 15752000,
appsec (14.608 s) : 14608000, 14608000
.   : milestone, 14608000,
iast (18.714 s) : 18714000, 18714000
.   : milestone, 18714000,
iast_GLOBAL (17.981 s) : 17981000, 17981000
.   : milestone, 17981000,
profiling (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
tracing (14.77 s) : 14770000, 14770000
.   : milestone, 14770000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.284 s [15.284 s, 15.284 s] -
appsec 14.815 s [14.815 s, 14.815 s] -469.0 ms (-3.1%)
iast 18.386 s [18.386 s, 18.386 s] 3.102 s (20.3%)
iast_GLOBAL 17.93 s [17.93 s, 17.93 s] 2.646 s (17.3%)
profiling 14.929 s [14.929 s, 14.929 s] -355.0 ms (-2.3%)
tracing 15.053 s [15.053 s, 15.053 s] -231.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.752 s [15.752 s, 15.752 s] -
appsec 14.608 s [14.608 s, 14.608 s] -1.144 s (-7.3%)
iast 18.714 s [18.714 s, 18.714 s] 2.962 s (18.8%)
iast_GLOBAL 17.981 s [17.981 s, 17.981 s] 2.229 s (14.2%)
profiling 14.889 s [14.889 s, 14.889 s] -863.0 ms (-5.5%)
tracing 14.77 s [14.77 s, 14.77 s] -982.0 ms (-6.2%)

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 94.36
agentless 90.26
agentlessCodeCoverage 99.59
agentlessLineCoverage 101.01

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 20.77
agentless 21.34
agentlessCodeCoverage 21.72
agentlessLineCoverage 38.17

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 14.72
agentless 7.73
agentlessCodeCoverage 12.20
agentlessLineCoverage 30.60

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 15.61
agentless 0.13
agentlessCodeCoverage 63.11
agentlessLineCoverage 91.49

@daniel-mohedano daniel-mohedano marked this pull request as ready for review February 6, 2026 10:34
@daniel-mohedano daniel-mohedano requested review from a team as code owners February 6, 2026 10:34
@daniel-mohedano daniel-mohedano requested review from mcculls and removed request for a team February 6, 2026 10:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-sdk-capabilities-java

+1 more reviewer

@anmarchenko anmarchenko anmarchenko approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@daniel-mohedano @anmarchenko @nikita-tkachenko-datadog