Skip to content

force keystore type for ubuntu17 #8939

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

force keystore type for ubuntu17 #8939

wants to merge 2 commits into from

Conversation

amarziali
Copy link
Collaborator

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@amarziali amarziali added the run-tests: ubuntu17 Run tests using Ubuntu 17 JDK label Jun 6, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 6, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ubuntu17
git_commit_date 1749044153 1749197723
git_commit_sha 7787af7 f0e52c5
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~f0e52c5ad4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749200206 1749200206
ci_job_id 971351030 971351030
ci_pipeline_id 67150622 67150622
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2ousnmcz-project-304-concurrent-0-zogzbmx8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2ousnmcz-project-304-concurrent-0-zogzbmx8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1022433
Total [baseline] (11.103 s) : 0, 11103222
Agent [candidate] (1.025 s) : 0, 1025400
Total [candidate] (11.11 s) : 0, 11109640
section appsec
Agent [baseline] (1.167 s) : 0, 1166747
Total [baseline] (11.207 s) : 0, 11207098
Agent [candidate] (1.166 s) : 0, 1166012
Total [candidate] (11.22 s) : 0, 11219707
section iast
Agent [baseline] (1.149 s) : 0, 1148988
Total [baseline] (11.347 s) : 0, 11347199
Agent [candidate] (1.151 s) : 0, 1150943
Total [candidate] (11.528 s) : 0, 11527930
section profiling
Agent [baseline] (1.265 s) : 0, 1265147
Total [baseline] (11.473 s) : 0, 11473212
Agent [candidate] (1.268 s) : 0, 1267839
Total [candidate] (11.473 s) : 0, 11472808
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent appsec 1.167 s 144.314 ms (14.1%)
Agent iast 1.149 s 126.555 ms (12.4%)
Agent profiling 1.265 s 242.714 ms (23.7%)
Total tracing 11.103 s -
Total appsec 11.207 s 103.876 ms (0.9%)
Total iast 11.347 s 243.977 ms (2.2%)
Total profiling 11.473 s 369.99 ms (3.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.166 s 140.612 ms (13.7%)
Agent iast 1.151 s 125.543 ms (12.2%)
Agent profiling 1.268 s 242.439 ms (23.6%)
Total tracing 11.11 s -
Total appsec 11.22 s 110.067 ms (1.0%)
Total iast 11.528 s 418.291 ms (3.8%)
Total profiling 11.473 s 363.168 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.626 ms) : 0, 681626
BytebuddyAgent [candidate] (686.047 ms) : 0, 686047
GlobalTracer [baseline] (239.496 ms) : 0, 239496
GlobalTracer [candidate] (239.71 ms) : 0, 239710
AppSec [baseline] (56.312 ms) : 0, 56312
AppSec [candidate] (56.901 ms) : 0, 56901
Debugger [baseline] (6.923 ms) : 0, 6923
Debugger [candidate] (6.871 ms) : 0, 6871
Remote Config [baseline] (744.603 µs) : 0, 745
Remote Config [candidate] (733.729 µs) : 0, 734
Telemetry [baseline] (13.68 ms) : 0, 13680
Telemetry [candidate] (11.381 ms) : 0, 11381
section appsec
BytebuddyAgent [baseline] (703.136 ms) : 0, 703136
BytebuddyAgent [candidate] (702.504 ms) : 0, 702504
GlobalTracer [baseline] (238.746 ms) : 0, 238746
GlobalTracer [candidate] (238.486 ms) : 0, 238486
AppSec [baseline] (176.227 ms) : 0, 176227
AppSec [candidate] (176.34 ms) : 0, 176340
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.995 ms) : 0, 5995
Remote Config [baseline] (628.18 µs) : 0, 628
Remote Config [candidate] (628.44 µs) : 0, 628
Telemetry [baseline] (7.371 ms) : 0, 7371
Telemetry [candidate] (7.381 ms) : 0, 7381
IAST [baseline] (22.096 ms) : 0, 22096
IAST [candidate] (21.873 ms) : 0, 21873
section iast
BytebuddyAgent [baseline] (801.039 ms) : 0, 801039
BytebuddyAgent [candidate] (802.568 ms) : 0, 802568
GlobalTracer [baseline] (230.344 ms) : 0, 230344
GlobalTracer [candidate] (230.629 ms) : 0, 230629
AppSec [baseline] (51.075 ms) : 0, 51075
AppSec [candidate] (53.481 ms) : 0, 53481
Debugger [baseline] (5.956 ms) : 0, 5956
Debugger [candidate] (6.021 ms) : 0, 6021
Remote Config [baseline] (588.225 µs) : 0, 588
Remote Config [candidate] (596.908 µs) : 0, 597
Telemetry [baseline] (7.871 ms) : 0, 7871
Telemetry [candidate] (7.917 ms) : 0, 7917
IAST [baseline] (28.518 ms) : 0, 28518
IAST [candidate] (26.173 ms) : 0, 26173
section profiling
ProfilingAgent [baseline] (102.701 ms) : 0, 102701
ProfilingAgent [candidate] (103.879 ms) : 0, 103879
BytebuddyAgent [baseline] (674.74 ms) : 0, 674740
BytebuddyAgent [candidate] (675.472 ms) : 0, 675472
GlobalTracer [baseline] (360.384 ms) : 0, 360384
GlobalTracer [candidate] (361.082 ms) : 0, 361082
AppSec [baseline] (61.597 ms) : 0, 61597
AppSec [candidate] (61.493 ms) : 0, 61493
Debugger [baseline] (6.072 ms) : 0, 6072
Debugger [candidate] (6.118 ms) : 0, 6118
Remote Config [baseline] (652.747 µs) : 0, 653
Remote Config [candidate] (661.735 µs) : 0, 662
Telemetry [baseline] (8.091 ms) : 0, 8091
Telemetry [candidate] (8.15 ms) : 0, 8150
Profiling [baseline] (102.727 ms) : 0, 102727
Profiling [candidate] (103.905 ms) : 0, 103905
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022776
Total [baseline] (8.556 s) : 0, 8556236
Agent [candidate] (1.02 s) : 0, 1020058
Total [candidate] (8.528 s) : 0, 8527579
section iast
Agent [baseline] (1.157 s) : 0, 1156678
Total [baseline] (9.183 s) : 0, 9182531
Agent [candidate] (1.148 s) : 0, 1147842
Total [candidate] (9.18 s) : 0, 9180226
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.147 s) : 0, 1147317
Total [baseline] (9.157 s) : 0, 9157243
Agent [candidate] (1.153 s) : 0, 1152678
Total [candidate] (9.167 s) : 0, 9167351
section iast_TELEMETRY_OFF
Agent [baseline] (1.146 s) : 0, 1145982
Total [baseline] (9.229 s) : 0, 9228662
Agent [candidate] (1.151 s) : 0, 1151144
Total [candidate] (9.217 s) : 0, 9217390
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.157 s 133.903 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.147 s 124.542 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.146 s 123.206 ms (12.0%)
Total tracing 8.556 s -
Total iast 9.183 s 626.295 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.157 s 601.007 ms (7.0%)
Total iast_TELEMETRY_OFF 9.229 s 672.426 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.148 s 127.784 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.153 s 132.62 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.151 s 131.087 ms (12.9%)
Total tracing 8.528 s -
Total iast 9.18 s 652.647 ms (7.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.167 s 639.772 ms (7.5%)
Total iast_TELEMETRY_OFF 9.217 s 689.81 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.163 ms) : 0, 682163
BytebuddyAgent [candidate] (682.194 ms) : 0, 682194
GlobalTracer [baseline] (239.713 ms) : 0, 239713
GlobalTracer [candidate] (240.083 ms) : 0, 240083
AppSec [baseline] (56.31 ms) : 0, 56310
AppSec [candidate] (55.774 ms) : 0, 55774
Debugger [baseline] (6.216 ms) : 0, 6216
Debugger [candidate] (7.003 ms) : 0, 7003
Remote Config [baseline] (772.19 µs) : 0, 772
Remote Config [candidate] (775.934 µs) : 0, 776
Telemetry [baseline] (13.905 ms) : 0, 13905
Telemetry [candidate] (10.725 ms) : 0, 10725
section iast
BytebuddyAgent [baseline] (807.764 ms) : 0, 807764
BytebuddyAgent [candidate] (800.398 ms) : 0, 800398
GlobalTracer [baseline] (231.559 ms) : 0, 231559
GlobalTracer [candidate] (230.105 ms) : 0, 230105
IAST [baseline] (27.022 ms) : 0, 27022
IAST [candidate] (26.003 ms) : 0, 26003
AppSec [baseline] (52.209 ms) : 0, 52209
AppSec [candidate] (53.539 ms) : 0, 53539
Debugger [baseline] (6.003 ms) : 0, 6003
Debugger [candidate] (5.921 ms) : 0, 5921
Remote Config [baseline] (600.211 µs) : 0, 600
Remote Config [candidate] (587.108 µs) : 0, 587
Telemetry [baseline] (7.907 ms) : 0, 7907
Telemetry [candidate] (7.836 ms) : 0, 7836
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.817 ms) : 0, 799817
BytebuddyAgent [candidate] (802.383 ms) : 0, 802383
GlobalTracer [baseline] (230.031 ms) : 0, 230031
GlobalTracer [candidate] (231.466 ms) : 0, 231466
IAST [baseline] (27.675 ms) : 0, 27675
IAST [candidate] (28.145 ms) : 0, 28145
AppSec [baseline] (51.811 ms) : 0, 51811
AppSec [candidate] (52.368 ms) : 0, 52368
Debugger [baseline] (5.94 ms) : 0, 5940
Debugger [candidate] (6.04 ms) : 0, 6040
Remote Config [baseline] (596.366 µs) : 0, 596
Remote Config [candidate] (599.244 µs) : 0, 599
Telemetry [baseline] (7.995 ms) : 0, 7995
Telemetry [candidate] (8.075 ms) : 0, 8075
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.345 ms) : 0, 798345
BytebuddyAgent [candidate] (802.848 ms) : 0, 802848
GlobalTracer [baseline] (230.886 ms) : 0, 230886
GlobalTracer [candidate] (231.133 ms) : 0, 231133
IAST [baseline] (28.679 ms) : 0, 28679
IAST [candidate] (28.736 ms) : 0, 28736
AppSec [baseline] (50.084 ms) : 0, 50084
AppSec [candidate] (50.341 ms) : 0, 50341
Debugger [baseline] (5.973 ms) : 0, 5973
Debugger [candidate] (6.03 ms) : 0, 6030
Remote Config [baseline] (594.123 µs) : 0, 594
Remote Config [candidate] (615.098 µs) : 0, 615
Telemetry [baseline] (7.902 ms) : 0, 7902
Telemetry [candidate] (7.929 ms) : 0, 7929
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-06T08:24:46 2025-06-06T08:35:38
git_branch master andrea.marziali/ubuntu17
git_commit_date 1749044153 1749197723
git_commit_sha 7787af7 f0e52c5
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~f0e52c5ad4
start_time 2025-06-06T08:24:31 2025-06-06T08:35:24
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749199522 1749199522
ci_job_id 971351031 971351031
ci_pipeline_id 67150622 67150622
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2ousnmcz-project-304-concurrent-1-m5qhizrf 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2ousnmcz-project-304-concurrent-1-m5qhizrf 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant iast iast

Summary

Found 5 performance improvements and 2 performance regressions! Performance is the same for 5 metrics, 18 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec better
[-35.050ms; -32.549ms] or [-98.487%; -91.460%]		 unstable
[+329.081op/s; +3817.081op/s] or [+241.284%; +2798.697%]		 1.789ms 2209.469op/s 35.589ms 136.388op/s
scenario:load:petclinic:appsec_no_iast better
[-43.507ms; -39.685ms] or [-102.365%; -93.371%]		 unstable
[+1016.534op/s; +6376.724op/s] or [+900.426%; +5648.381%]		 0.906ms 3809.524op/s 42.502ms 112.895op/s
scenario:load:petclinic:no_agent worse
[+544.034µs; +591.005µs] or [+7.530%; +8.180%]		 worse
[-65.333op/s; -32.347op/s] or [-9.555%; -4.731%]		 7.793ms 634.921op/s 7.225ms 683.761op/s
scenario:load:petclinic:profiling better
[-1.442ms; -1.288ms] or [-12.649%; -11.296%]		 unstable
[+21.660op/s; +90.370op/s] or [+4.982%; +20.785%]		 10.037ms 490.798op/s 11.402ms 434.783op/s
scenario:load:petclinic:tracing better
[-638.376µs; -582.741µs] or [-8.134%; -7.425%]		 better
[+28.555op/s; +67.535op/s] or [+4.533%; +10.721%]		 7.237ms 677.966op/s 7.848ms 629.921op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (7.225 ms) : 7203, 7247
.   : milestone, 7225,
appsec (35.589 ms) : 33947, 37230
.   : milestone, 35589,
appsec_no_iast (42.502 ms) : 39991, 45013
.   : milestone, 42502,
code_origins (53.63 ms) : 45351, 61908
.   : milestone, 53630,
iast (47.968 ms) : 43887, 52050
.   : milestone, 47968,
profiling (11.402 ms) : 11314, 11490
.   : milestone, 11402,
tracing (7.848 ms) : 7822, 7874
.   : milestone, 7848,
section candidate
no_agent (7.793 ms) : 7771, 7814
.   : milestone, 7793,
appsec (1.789 ms) : 1718, 1860
.   : milestone, 1789,
appsec_no_iast (906.143 µs) : 839, 973
.   : milestone, 906,
code_origins (87.53 µs) : 44, 131
.   : milestone, 88,
iast (185.257 µs) : 136, 235
.   : milestone, 185,
profiling (10.037 ms) : 9987, 10088
.   : milestone, 10037,
tracing (7.237 ms) : 7212, 7263
.   : milestone, 7237,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.225 ms [7.203 ms, 7.247 ms] -
appsec 35.589 ms [33.947 ms, 37.23 ms] 28.364 ms (392.6%)
appsec_no_iast 42.502 ms [39.991 ms, 45.013 ms] 35.277 ms (488.3%)
code_origins 53.63 ms [45.351 ms, 61.908 ms] 46.405 ms (642.3%)
iast 47.968 ms [43.887 ms, 52.05 ms] 40.743 ms (563.9%)
profiling 11.402 ms [11.314 ms, 11.49 ms] 4.177 ms (57.8%)
tracing 7.848 ms [7.822 ms, 7.874 ms] 622.827 µs (8.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.793 ms [7.771 ms, 7.814 ms] -
appsec 1.789 ms [1.718 ms, 1.86 ms] -6.004 ms (-77.0%)
appsec_no_iast 906.143 µs [838.869 µs, 973.417 µs] -6.886 ms (-88.4%)
code_origins 87.53 µs [44.278 µs, 130.782 µs] -7.705 ms (-98.9%)
iast 185.257 µs [135.61 µs, 234.903 µs] -7.607 ms (-97.6%)
profiling 10.037 ms [9.987 ms, 10.088 ms] 2.245 ms (28.8%)
tracing 7.237 ms [7.212 ms, 7.263 ms] -555.251 µs (-7.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.632 µs) : 359, 400
.   : milestone, 380,
iast (522.267 µs) : 500, 544
.   : milestone, 522,
iast_FULL (741.069 µs) : 717, 765
.   : milestone, 741,
iast_GLOBAL (564.908 µs) : 541, 589
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (525.941 µs) : 504, 548
.   : milestone, 526,
iast_INACTIVE (473.377 µs) : 451, 496
.   : milestone, 473,
iast_TELEMETRY_OFF (516.196 µs) : 493, 539
.   : milestone, 516,
tracing (464.148 µs) : 442, 486
.   : milestone, 464,
section candidate
no_agent (170.661 µs) : 148, 193
.   : milestone, 171,
iast (519.338 µs) : 496, 543
.   : milestone, 519,
iast_FULL (741.783 µs) : 718, 765
.   : milestone, 742,
iast_GLOBAL (573.915 µs) : 550, 598
.   : milestone, 574,
iast_HARDCODED_SECRET_DISABLED (517.441 µs) : 496, 539
.   : milestone, 517,
iast_INACTIVE (478.496 µs) : 455, 502
.   : milestone, 478,
iast_TELEMETRY_OFF (514.721 µs) : 492, 538
.   : milestone, 515,
tracing (458.314 µs) : 436, 480
.   : milestone, 458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.632 µs [359.325 µs, 399.939 µs] -
iast 522.267 µs [500.371 µs, 544.164 µs] 142.635 µs (37.6%)
iast_FULL 741.069 µs [717.413 µs, 764.725 µs] 361.437 µs (95.2%)
iast_GLOBAL 564.908 µs [541.282 µs, 588.533 µs] 185.276 µs (48.8%)
iast_HARDCODED_SECRET_DISABLED 525.941 µs [504.3 µs, 547.582 µs] 146.31 µs (38.5%)
iast_INACTIVE 473.377 µs [450.829 µs, 495.925 µs] 93.745 µs (24.7%)
iast_TELEMETRY_OFF 516.196 µs [493.031 µs, 539.361 µs] 136.564 µs (36.0%)
tracing 464.148 µs [441.922 µs, 486.374 µs] 84.516 µs (22.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 170.661 µs [148.018 µs, 193.305 µs] -
iast 519.338 µs [496.065 µs, 542.611 µs] 348.676 µs (204.3%)
iast_FULL 741.783 µs [718.089 µs, 765.476 µs] 571.122 µs (334.7%)
iast_GLOBAL 573.915 µs [550.133 µs, 597.698 µs] 403.254 µs (236.3%)
iast_HARDCODED_SECRET_DISABLED 517.441 µs [495.745 µs, 539.138 µs] 346.78 µs (203.2%)
iast_INACTIVE 478.496 µs [455.489 µs, 501.503 µs] 307.835 µs (180.4%)
iast_TELEMETRY_OFF 514.721 µs [491.508 µs, 537.934 µs] 344.06 µs (201.6%)
tracing 458.314 µs [436.472 µs, 480.155 µs] 287.652 µs (168.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ubuntu17
git_commit_date 1749044153 1749197723
git_commit_sha 7787af7 f0e52c5
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~f0e52c5ad4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749199628 1749199628
ci_job_id 971351032 971351032
ci_pipeline_id 67150622 67150622
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ytwrhy75-project-304-concurrent-0-yqt4de60 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ytwrhy75-project-304-concurrent-0-yqt4de60 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.397 ms) : 2348, 2445
.   : milestone, 2397,
iast (2.184 ms) : 2123, 2245
.   : milestone, 2184,
iast_GLOBAL (2.227 ms) : 2166, 2289
.   : milestone, 2227,
profiling (2.489 ms) : 2311, 2666
.   : milestone, 2489,
tracing (1.998 ms) : 1951, 2045
.   : milestone, 1998,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.408 ms) : 2360, 2457
.   : milestone, 2408,
iast (2.181 ms) : 2120, 2242
.   : milestone, 2181,
iast_GLOBAL (2.235 ms) : 2173, 2297
.   : milestone, 2235,
profiling (2.022 ms) : 1973, 2070
.   : milestone, 2022,
tracing (1.998 ms) : 1951, 2045
.   : milestone, 1998,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.397 ms [2.348 ms, 2.445 ms] 920.887 µs (62.4%)
iast 2.184 ms [2.123 ms, 2.245 ms] 708.329 µs (48.0%)
iast_GLOBAL 2.227 ms [2.166 ms, 2.289 ms] 751.656 µs (50.9%)
profiling 2.489 ms [2.311 ms, 2.666 ms] 1.013 ms (68.7%)
tracing 1.998 ms [1.951 ms, 2.045 ms] 522.066 µs (35.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.408 ms [2.36 ms, 2.457 ms] 934.986 µs (63.5%)
iast 2.181 ms [2.12 ms, 2.242 ms] 707.337 µs (48.0%)
iast_GLOBAL 2.235 ms [2.173 ms, 2.297 ms] 761.783 µs (51.7%)
profiling 2.022 ms [1.973 ms, 2.07 ms] 548.289 µs (37.2%)
tracing 1.998 ms [1.951 ms, 2.045 ms] 524.796 µs (35.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~f0e52c5ad4, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.986 s) : 14986000, 14986000
.   : milestone, 14986000,
appsec (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
iast (18.504 s) : 18504000, 18504000
.   : milestone, 18504000,
iast_GLOBAL (17.933 s) : 17933000, 17933000
.   : milestone, 17933000,
profiling (15.186 s) : 15186000, 15186000
.   : milestone, 15186000,
tracing (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
section candidate
no_agent (15.53 s) : 15530000, 15530000
.   : milestone, 15530000,
appsec (14.896 s) : 14896000, 14896000
.   : milestone, 14896000,
iast (19.166 s) : 19166000, 19166000
.   : milestone, 19166000,
iast_GLOBAL (17.79 s) : 17790000, 17790000
.   : milestone, 17790000,
profiling (15.236 s) : 15236000, 15236000
.   : milestone, 15236000,
tracing (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.986 s [14.986 s, 14.986 s] -
appsec 14.948 s [14.948 s, 14.948 s] -38.0 ms (-0.3%)
iast 18.504 s [18.504 s, 18.504 s] 3.518 s (23.5%)
iast_GLOBAL 17.933 s [17.933 s, 17.933 s] 2.947 s (19.7%)
profiling 15.186 s [15.186 s, 15.186 s] 200.0 ms (1.3%)
tracing 15.126 s [15.126 s, 15.126 s] 140.0 ms (0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.53 s [15.53 s, 15.53 s] -
appsec 14.896 s [14.896 s, 14.896 s] -634.0 ms (-4.1%)
iast 19.166 s [19.166 s, 19.166 s] 3.636 s (23.4%)
iast_GLOBAL 17.79 s [17.79 s, 17.79 s] 2.26 s (14.6%)
profiling 15.236 s [15.236 s, 15.236 s] -294.0 ms (-1.9%)
tracing 14.898 s [14.898 s, 14.898 s] -632.0 ms (-4.1%)

@amarziali amarziali closed this Jun 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
run-tests: ubuntu17 Run tests using Ubuntu 17 JDK
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@amarziali