Skip to content

Adjust pin-system-tests workflow trigger to be release tag#10504

Draft
sarahchen6 wants to merge 4 commits intomasterfrom
sarahchen6/fix-pin-system-test
Draft

Adjust pin-system-tests workflow trigger to be release tag#10504
sarahchen6 wants to merge 4 commits intomasterfrom
sarahchen6/fix-pin-system-test

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Feb 2, 2026 •
edited
Loading

What Does This Do

Adjust the pin-system-tests workflow to be off the release tag instead of a release branch. For the v1.59.0 release, we see that github.ref: refs/tags/v1.59.0 triggered the workflow, not the previously expected refs/heads/release/v1.59.x branch creation here.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 requested a review from a team as a code owner February 2, 2026 19:43
@sarahchen6 sarahchen6 requested review from AlexeyKuznetsov-DD and removed request for a team February 2, 2026 19:43
@sarahchen6 sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes labels Feb 2, 2026
@sarahchen6 sarahchen6 force-pushed the sarahchen6/fix-pin-system-test branch from 539f77c to b309264 Compare February 2, 2026 19:54
@pr-commenter
Copy link

pr-commenter bot commented Feb 2, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-pin-system-test
git_commit_date 1770126777 1770155220
git_commit_sha 4914aae 75adc56
release_version 1.60.0-SNAPSHOT~4914aaefbc 1.60.0-SNAPSHOT~75adc56e0c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770157096 1770157096
ci_job_id 1398838601 1398838601
ci_pipeline_id 94477357 94477357
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-u5w5pc8g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-u5w5pc8g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063880
Total [baseline] (8.768 s) : 0, 8768102
Agent [candidate] (1.07 s) : 0, 1070066
Total [candidate] (8.776 s) : 0, 8775690
section iast
Agent [baseline] (1.229 s) : 0, 1228837
Total [baseline] (9.366 s) : 0, 9365683
Agent [candidate] (1.234 s) : 0, 1233955
Total [candidate] (9.37 s) : 0, 9370225
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.229 s 164.957 ms (15.5%)
Total tracing 8.768 s -
Total iast 9.366 s 597.581 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.234 s 163.888 ms (15.3%)
Total tracing 8.776 s -
Total iast 9.37 s 594.535 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (629.115 ms) : 0, 629115
BytebuddyAgent [candidate] (633.752 ms) : 0, 633752
AgentMeter [baseline] (28.727 ms) : 0, 28727
AgentMeter [candidate] (29.028 ms) : 0, 29028
GlobalTracer [baseline] (257.91 ms) : 0, 257910
GlobalTracer [candidate] (259.019 ms) : 0, 259019
AppSec [baseline] (33.05 ms) : 0, 33050
AppSec [candidate] (32.965 ms) : 0, 32965
Debugger [baseline] (60.972 ms) : 0, 60972
Debugger [candidate] (60.905 ms) : 0, 60905
Remote Config [baseline] (617.054 µs) : 0, 617
Remote Config [candidate] (620.447 µs) : 0, 620
Telemetry [baseline] (11.478 ms) : 0, 11478
Telemetry [candidate] (11.635 ms) : 0, 11635
Flare Poller [baseline] (5.355 ms) : 0, 5355
Flare Poller [candidate] (5.422 ms) : 0, 5422
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (795.042 ms) : 0, 795042
BytebuddyAgent [candidate] (797.7 ms) : 0, 797700
AgentMeter [baseline] (11.132 ms) : 0, 11132
AgentMeter [candidate] (11.214 ms) : 0, 11214
GlobalTracer [baseline] (247.434 ms) : 0, 247434
GlobalTracer [candidate] (248.442 ms) : 0, 248442
AppSec [baseline] (34.769 ms) : 0, 34769
AppSec [candidate] (34.807 ms) : 0, 34807
Debugger [baseline] (64.448 ms) : 0, 64448
Debugger [candidate] (65.444 ms) : 0, 65444
Remote Config [baseline] (539.673 µs) : 0, 540
Remote Config [candidate] (542.277 µs) : 0, 542
Telemetry [baseline] (8.634 ms) : 0, 8634
Telemetry [candidate] (8.622 ms) : 0, 8622
Flare Poller [baseline] (3.434 ms) : 0, 3434
Flare Poller [candidate] (3.441 ms) : 0, 3441
IAST [baseline] (26.857 ms) : 0, 26857
IAST [candidate] (27.145 ms) : 0, 27145
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067433
Total [baseline] (10.874 s) : 0, 10874069
Agent [candidate] (1.078 s) : 0, 1078297
Total [candidate] (10.874 s) : 0, 10873902
section appsec
Agent [baseline] (1.236 s) : 0, 1236425
Total [baseline] (11.006 s) : 0, 11006333
Agent [candidate] (1.242 s) : 0, 1241796
Total [candidate] (11.03 s) : 0, 11029620
section iast
Agent [baseline] (1.234 s) : 0, 1234198
Total [baseline] (11.207 s) : 0, 11206891
Agent [candidate] (1.247 s) : 0, 1246723
Total [candidate] (11.27 s) : 0, 11269687
section profiling
Agent [baseline] (1.193 s) : 0, 1193028
Total [baseline] (10.99 s) : 0, 10989944
Agent [candidate] (1.199 s) : 0, 1199046
Total [candidate] (11.018 s) : 0, 11018486
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.236 s 168.992 ms (15.8%)
Agent iast 1.234 s 166.765 ms (15.6%)
Agent profiling 1.193 s 125.595 ms (11.8%)
Total tracing 10.874 s -
Total appsec 11.006 s 132.265 ms (1.2%)
Total iast 11.207 s 332.822 ms (3.1%)
Total profiling 10.99 s 115.875 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent appsec 1.242 s 163.499 ms (15.2%)
Agent iast 1.247 s 168.426 ms (15.6%)
Agent profiling 1.199 s 120.75 ms (11.2%)
Total tracing 10.874 s -
Total appsec 11.03 s 155.718 ms (1.4%)
Total iast 11.27 s 395.785 ms (3.6%)
Total profiling 11.018 s 144.584 ms (1.3%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (629.24 ms) : 0, 629240
BytebuddyAgent [candidate] (635.44 ms) : 0, 635440
AgentMeter [baseline] (28.785 ms) : 0, 28785
AgentMeter [candidate] (29.329 ms) : 0, 29329
GlobalTracer [baseline] (258.095 ms) : 0, 258095
GlobalTracer [candidate] (262.082 ms) : 0, 262082
AppSec [baseline] (32.858 ms) : 0, 32858
AppSec [candidate] (33.507 ms) : 0, 33507
Debugger [baseline] (62.762 ms) : 0, 62762
Debugger [candidate] (62.47 ms) : 0, 62470
Remote Config [baseline] (614.872 µs) : 0, 615
Remote Config [candidate] (635.874 µs) : 0, 636
Telemetry [baseline] (13.013 ms) : 0, 13013
Telemetry [candidate] (12.511 ms) : 0, 12511
Flare Poller [baseline] (5.484 ms) : 0, 5484
Flare Poller [candidate] (5.355 ms) : 0, 5355
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (656.976 ms) : 0, 656976
BytebuddyAgent [candidate] (659.475 ms) : 0, 659475
AgentMeter [baseline] (11.75 ms) : 0, 11750
AgentMeter [candidate] (11.808 ms) : 0, 11808
GlobalTracer [baseline] (258.05 ms) : 0, 258050
GlobalTracer [candidate] (259.183 ms) : 0, 259183
AppSec [baseline] (167.811 ms) : 0, 167811
AppSec [candidate] (168.698 ms) : 0, 168698
Debugger [baseline] (66.795 ms) : 0, 66795
Debugger [candidate] (67.061 ms) : 0, 67061
Remote Config [baseline] (687.801 µs) : 0, 688
Remote Config [candidate] (680.719 µs) : 0, 681
Telemetry [baseline] (9.06 ms) : 0, 9060
Telemetry [candidate] (9.16 ms) : 0, 9160
Flare Poller [baseline] (3.583 ms) : 0, 3583
Flare Poller [candidate] (3.689 ms) : 0, 3689
IAST [baseline] (25.182 ms) : 0, 25182
IAST [candidate] (25.355 ms) : 0, 25355
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (798.17 ms) : 0, 798170
BytebuddyAgent [candidate] (806.478 ms) : 0, 806478
AgentMeter [baseline] (11.151 ms) : 0, 11151
AgentMeter [candidate] (11.664 ms) : 0, 11664
GlobalTracer [baseline] (248.333 ms) : 0, 248333
GlobalTracer [candidate] (250.401 ms) : 0, 250401
AppSec [baseline] (32.945 ms) : 0, 32945
AppSec [candidate] (33.359 ms) : 0, 33359
Debugger [baseline] (67.339 ms) : 0, 67339
Debugger [candidate] (68.054 ms) : 0, 68054
Remote Config [baseline] (535.582 µs) : 0, 536
Remote Config [candidate] (542.663 µs) : 0, 543
Telemetry [baseline] (8.676 ms) : 0, 8676
Telemetry [candidate] (8.648 ms) : 0, 8648
Flare Poller [baseline] (3.429 ms) : 0, 3429
Flare Poller [candidate] (3.411 ms) : 0, 3411
IAST [baseline] (27.067 ms) : 0, 27067
IAST [candidate] (27.315 ms) : 0, 27315
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (683.072 ms) : 0, 683072
BytebuddyAgent [candidate] (687.101 ms) : 0, 687101
AgentMeter [baseline] (8.681 ms) : 0, 8681
AgentMeter [candidate] (8.656 ms) : 0, 8656
GlobalTracer [baseline] (216.574 ms) : 0, 216574
GlobalTracer [candidate] (217.664 ms) : 0, 217664
AppSec [baseline] (32.721 ms) : 0, 32721
AppSec [candidate] (32.698 ms) : 0, 32698
Debugger [baseline] (67.938 ms) : 0, 67938
Debugger [candidate] (68.061 ms) : 0, 68061
Remote Config [baseline] (613.771 µs) : 0, 614
Remote Config [candidate] (609.561 µs) : 0, 610
Telemetry [baseline] (8.947 ms) : 0, 8947
Telemetry [candidate] (8.881 ms) : 0, 8881
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (3.846 ms) : 0, 3846
ProfilingAgent [baseline] (99.386 ms) : 0, 99386
ProfilingAgent [candidate] (99.987 ms) : 0, 99987
Profiling [baseline] (99.958 ms) : 0, 99958
Profiling [candidate] (100.559 ms) : 0, 100559
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-pin-system-test
git_commit_date 1770126777 1770155220
git_commit_sha 4914aae 75adc56
release_version 1.60.0-SNAPSHOT~4914aaefbc 1.60.0-SNAPSHOT~75adc56e0c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770157492 1770157492
ci_job_id 1398838603 1398838603
ci_pipeline_id 94477357 94477357
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5h8sb9fl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5h8sb9fl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+145.200µs; +229.317µs] or [+6.061%; +9.573%]		 unsure
[+102.065µs; +415.062µs] or [+1.424%; +5.792%]		 unstable
[-230.058op/s; +68.433op/s] or [-15.664%; +4.659%]		 2.583ms 7.424ms 1387.875op/s 2.395ms 7.166ms 1468.688op/s
scenario:load:petclinic:code_origins:high_load better
[-1074.383µs; -359.347µs] or [-6.011%; -2.010%]		 unsure
[-1.934ms; -0.205ms] or [-6.583%; -0.699%]		 unstable
[-18.959op/s; +36.896op/s] or [-7.397%; +14.395%]		 17.157ms 28.305ms 265.281op/s 17.874ms 29.375ms 256.312op/s
scenario:load:petclinic:appsec:high_load worse
[+0.986ms; +1.974ms] or [+5.500%; +11.016%]		 worse
[+1.116ms; +2.548ms] or [+3.788%; +8.645%]		 unstable
[-44.492op/s; +9.304op/s] or [-17.476%; +3.655%]		 19.401ms 31.300ms 237.000op/s 17.921ms 29.468ms 254.594op/s
scenario:load:petclinic:tracing:high_load better
[-2.115ms; -0.788ms] or [-11.390%; -4.241%]		 same
[-2.554ms; +0.130ms] or [-8.539%; +0.435%]		 unstable
[-14.536op/s; +42.224op/s] or [-5.800%; +16.847%]		 17.118ms 28.695ms 264.469op/s 18.569ms 29.907ms 250.625op/s
scenario:load:petclinic:iast:high_load better
[-1433.939µs; -558.996µs] or [-7.775%; -3.031%]		 better
[-2.137ms; -0.785ms] or [-7.109%; -2.610%]		 unstable
[-14.521op/s; +41.083op/s] or [-5.832%; +16.499%]		 17.447ms 28.608ms 262.281op/s 18.443ms 30.069ms 249.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.077 ms) : 18881, 19273
.   : milestone, 19077,
appsec (18.33 ms) : 18144, 18517
.   : milestone, 18330,
code_origins (18.207 ms) : 18022, 18392
.   : milestone, 18207,
iast (18.741 ms) : 18552, 18930
.   : milestone, 18741,
profiling (18.362 ms) : 18184, 18541
.   : milestone, 18362,
tracing (18.619 ms) : 18433, 18806
.   : milestone, 18619,
section candidate
no_agent (18.227 ms) : 18042, 18411
.   : milestone, 18227,
appsec (19.699 ms) : 19498, 19901
.   : milestone, 19699,
code_origins (17.586 ms) : 17411, 17761
.   : milestone, 17586,
iast (17.788 ms) : 17613, 17963
.   : milestone, 17788,
profiling (18.87 ms) : 18683, 19057
.   : milestone, 18870,
tracing (17.641 ms) : 17458, 17824
.   : milestone, 17641,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.077 ms [18.881 ms, 19.273 ms] -
appsec 18.33 ms [18.144 ms, 18.517 ms] -746.77 µs (-3.9%)
code_origins 18.207 ms [18.022 ms, 18.392 ms] -870.169 µs (-4.6%)
iast 18.741 ms [18.552 ms, 18.93 ms] -335.88 µs (-1.8%)
profiling 18.362 ms [18.184 ms, 18.541 ms] -714.615 µs (-3.7%)
tracing 18.619 ms [18.433 ms, 18.806 ms] -457.775 µs (-2.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.227 ms [18.042 ms, 18.411 ms] -
appsec 19.699 ms [19.498 ms, 19.901 ms] 1.473 ms (8.1%)
code_origins 17.586 ms [17.411 ms, 17.761 ms] -640.926 µs (-3.5%)
iast 17.788 ms [17.613 ms, 17.963 ms] -438.424 µs (-2.4%)
profiling 18.87 ms [18.683 ms, 19.057 ms] 643.374 µs (3.5%)
tracing 17.641 ms [17.458 ms, 17.824 ms] -585.542 µs (-3.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1170, 1193
.   : milestone, 1181,
iast (3.113 ms) : 3075, 3151
.   : milestone, 3113,
iast_FULL (5.873 ms) : 5813, 5932
.   : milestone, 5873,
iast_GLOBAL (3.497 ms) : 3445, 3549
.   : milestone, 3497,
profiling (2.164 ms) : 2143, 2185
.   : milestone, 2164,
tracing (1.795 ms) : 1780, 1810
.   : milestone, 1795,
section candidate
no_agent (1.185 ms) : 1174, 1196
.   : milestone, 1185,
iast (3.298 ms) : 3251, 3345
.   : milestone, 3298,
iast_FULL (5.943 ms) : 5884, 6003
.   : milestone, 5943,
iast_GLOBAL (3.534 ms) : 3473, 3594
.   : milestone, 3534,
profiling (2.04 ms) : 2022, 2059
.   : milestone, 2040,
tracing (1.79 ms) : 1775, 1804
.   : milestone, 1790,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.17 ms, 1.193 ms] -
iast 3.113 ms [3.075 ms, 3.151 ms] 1.932 ms (163.5%)
iast_FULL 5.873 ms [5.813 ms, 5.932 ms] 4.691 ms (397.1%)
iast_GLOBAL 3.497 ms [3.445 ms, 3.549 ms] 2.316 ms (196.0%)
profiling 2.164 ms [2.143 ms, 2.185 ms] 982.65 µs (83.2%)
tracing 1.795 ms [1.78 ms, 1.81 ms] 613.764 µs (52.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.174 ms, 1.196 ms] -
iast 3.298 ms [3.251 ms, 3.345 ms] 2.113 ms (178.3%)
iast_FULL 5.943 ms [5.884 ms, 6.003 ms] 4.758 ms (401.5%)
iast_GLOBAL 3.534 ms [3.473 ms, 3.594 ms] 2.349 ms (198.2%)
profiling 2.04 ms [2.022 ms, 2.059 ms] 855.266 µs (72.2%)
tracing 1.79 ms [1.775 ms, 1.804 ms] 604.583 µs (51.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-pin-system-test
git_commit_date 1770126777 1770155220
git_commit_sha 4914aae 75adc56
release_version 1.60.0-SNAPSHOT~4914aaefbc 1.60.0-SNAPSHOT~75adc56e0c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770157273 1770157273
ci_job_id 1398838605 1398838605
ci_pipeline_id 94477357 94477357
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-0h8svawv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-0h8svawv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.447ms; -1.099ms] or [-38.413%; -29.172%]		 2.494ms 3.767ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.052 s) : 15052000, 15052000
.   : milestone, 15052000,
appsec (14.743 s) : 14743000, 14743000
.   : milestone, 14743000,
iast (18.428 s) : 18428000, 18428000
.   : milestone, 18428000,
iast_GLOBAL (18.103 s) : 18103000, 18103000
.   : milestone, 18103000,
profiling (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
tracing (14.823 s) : 14823000, 14823000
.   : milestone, 14823000,
section candidate
no_agent (15.564 s) : 15564000, 15564000
.   : milestone, 15564000,
appsec (14.886 s) : 14886000, 14886000
.   : milestone, 14886000,
iast (17.791 s) : 17791000, 17791000
.   : milestone, 17791000,
iast_GLOBAL (18.002 s) : 18002000, 18002000
.   : milestone, 18002000,
profiling (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
tracing (14.678 s) : 14678000, 14678000
.   : milestone, 14678000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.052 s [15.052 s, 15.052 s] -
appsec 14.743 s [14.743 s, 14.743 s] -309.0 ms (-2.1%)
iast 18.428 s [18.428 s, 18.428 s] 3.376 s (22.4%)
iast_GLOBAL 18.103 s [18.103 s, 18.103 s] 3.051 s (20.3%)
profiling 14.918 s [14.918 s, 14.918 s] -134.0 ms (-0.9%)
tracing 14.823 s [14.823 s, 14.823 s] -229.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.564 s [15.564 s, 15.564 s] -
appsec 14.886 s [14.886 s, 14.886 s] -678.0 ms (-4.4%)
iast 17.791 s [17.791 s, 17.791 s] 2.227 s (14.3%)
iast_GLOBAL 18.002 s [18.002 s, 18.002 s] 2.438 s (15.7%)
profiling 14.894 s [14.894 s, 14.894 s] -670.0 ms (-4.3%)
tracing 14.678 s [14.678 s, 14.678 s] -886.0 ms (-5.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~75adc56e0c, baseline=1.60.0-SNAPSHOT~4914aaefbc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.767 ms) : 3545, 3989
.   : milestone, 3767,
iast (2.255 ms) : 2187, 2324
.   : milestone, 2255,
iast_GLOBAL (2.301 ms) : 2231, 2370
.   : milestone, 2301,
profiling (2.068 ms) : 2014, 2122
.   : milestone, 2068,
tracing (2.056 ms) : 2002, 2109
.   : milestone, 2056,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.494 ms) : 2439, 2549
.   : milestone, 2494,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.106 ms) : 2049, 2163
.   : milestone, 2106,
tracing (2.058 ms) : 2004, 2111
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.767 ms [3.545 ms, 3.989 ms] 2.296 ms (156.1%)
iast 2.255 ms [2.187 ms, 2.324 ms] 784.285 µs (53.3%)
iast_GLOBAL 2.301 ms [2.231 ms, 2.37 ms] 829.464 µs (56.4%)
profiling 2.068 ms [2.014 ms, 2.122 ms] 596.909 µs (40.6%)
tracing 2.056 ms [2.002 ms, 2.109 ms] 584.556 µs (39.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.494 ms [2.439 ms, 2.549 ms] 1.02 ms (69.2%)
iast 2.252 ms [2.183 ms, 2.321 ms] 777.934 µs (52.8%)
iast_GLOBAL 2.303 ms [2.233 ms, 2.372 ms] 828.92 µs (56.2%)
profiling 2.106 ms [2.049 ms, 2.163 ms] 632.09 µs (42.9%)
tracing 2.058 ms [2.004 ms, 2.111 ms] 583.924 µs (39.6%)

PerfectSlayer
PerfectSlayer reviewed Feb 3, 2026
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❔ question: ‏Dumb question because I might be missing something.
If it’s triggered from the tag, the release/xxx branch does not exists yet. It will be creating later in another workflow run.
So how PR creation is supposed to work if the base branch does not exist?

Additionally, on line 76, it says "creating it now" but it does not create it -- and I don’t think it does at it will conflict with the other workflow in charge of this task.

@PerfectSlayer PerfectSlayer added the comp: tooling Build & Tooling label Feb 3, 2026
@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Feb 3, 2026

If it’s triggered from the tag, the release/xxx branch does not exists yet. It will be creating later in another workflow run.
So how PR creation is supposed to work if the base branch does not exist?

@PerfectSlayer Yes I think your idea of linking this to the release-branch-creation workflow makes sense! I had been timing the job execution durations, but that's not as reliable.

on line 76, it says "creating it now" but it does not create it -- and I don’t think it does at it will conflict with the other workflow in charge of this task.

Line 76 refers to the creation of the ci/pin-system-tests-* branch. I can make the step name more clear!

@sarahchen6 sarahchen6 marked this pull request as draft February 3, 2026 18:56
@sarahchen6 sarahchen6 force-pushed the sarahchen6/fix-pin-system-test branch from fd65d88 to e685c5a Compare February 3, 2026 21:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer left review comments

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD AlexeyKuznetsov-DD is a code owner automatically assigned from DataDog/apm-lang-platform-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6 @PerfectSlayer