-
Notifications
You must be signed in to change notification settings - Fork 306
Remove ubuntu17 from test variants #8953
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
bric3
approved these changes
Jun 10, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1027487
Total [baseline] (8.529 s) : 0, 8528620
Agent [candidate] (1.03 s) : 0, 1029666
Total [candidate] (8.532 s) : 0, 8531742
section iast
Agent [baseline] (1.151 s) : 0, 1150752
Total [baseline] (9.215 s) : 0, 9215134
Agent [candidate] (1.148 s) : 0, 1148371
Total [candidate] (9.165 s) : 0, 9164975
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.162 s) : 0, 1161561
Total [baseline] (9.143 s) : 0, 9142507
Agent [candidate] (1.154 s) : 0, 1154187
Total [candidate] (9.154 s) : 0, 9154475
section iast_TELEMETRY_OFF
Agent [baseline] (1.159 s) : 0, 1158839
Total [baseline] (9.202 s) : 0, 9201719
Agent [candidate] (1.145 s) : 0, 1145371
Total [candidate] (9.206 s) : 0, 9205799
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.964 ms) : 0, 684964
BytebuddyAgent [candidate] (687.397 ms) : 0, 687397
GlobalTracer [baseline] (241.824 ms) : 0, 241824
GlobalTracer [candidate] (241.324 ms) : 0, 241324
AppSec [baseline] (57.381 ms) : 0, 57381
AppSec [candidate] (59.034 ms) : 0, 59034
Debugger [baseline] (6.237 ms) : 0, 6237
Debugger [candidate] (6.119 ms) : 0, 6119
Remote Config [baseline] (743.972 µs) : 0, 744
Remote Config [candidate] (722.248 µs) : 0, 722
Telemetry [baseline] (12.779 ms) : 0, 12779
Telemetry [candidate] (11.415 ms) : 0, 11415
section iast
BytebuddyAgent [baseline] (802.65 ms) : 0, 802650
BytebuddyAgent [candidate] (800.903 ms) : 0, 800903
GlobalTracer [baseline] (230.75 ms) : 0, 230750
GlobalTracer [candidate] (230.055 ms) : 0, 230055
IAST [baseline] (25.419 ms) : 0, 25419
IAST [candidate] (24.625 ms) : 0, 24625
AppSec [baseline] (54.063 ms) : 0, 54063
AppSec [candidate] (55.046 ms) : 0, 55046
Debugger [baseline] (5.971 ms) : 0, 5971
Debugger [candidate] (5.9 ms) : 0, 5900
Remote Config [baseline] (579.123 µs) : 0, 579
Remote Config [candidate] (579.305 µs) : 0, 579
Telemetry [baseline] (7.875 ms) : 0, 7875
Telemetry [candidate] (7.84 ms) : 0, 7840
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (809.311 ms) : 0, 809311
BytebuddyAgent [candidate] (804.692 ms) : 0, 804692
GlobalTracer [baseline] (233.111 ms) : 0, 233111
GlobalTracer [candidate] (231.305 ms) : 0, 231305
IAST [baseline] (28.307 ms) : 0, 28307
IAST [candidate] (26.354 ms) : 0, 26354
AppSec [baseline] (52.395 ms) : 0, 52395
AppSec [candidate] (53.715 ms) : 0, 53715
Debugger [baseline] (6.063 ms) : 0, 6063
Debugger [candidate] (6.01 ms) : 0, 6010
Remote Config [baseline] (623.535 µs) : 0, 624
Remote Config [candidate] (588.973 µs) : 0, 589
Telemetry [baseline] (8.132 ms) : 0, 8132
Telemetry [candidate] (7.991 ms) : 0, 7991
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (808.752 ms) : 0, 808752
BytebuddyAgent [candidate] (797.722 ms) : 0, 797722
GlobalTracer [baseline] (232.062 ms) : 0, 232062
GlobalTracer [candidate] (230.491 ms) : 0, 230491
IAST [baseline] (28.429 ms) : 0, 28429
IAST [candidate] (25.711 ms) : 0, 25711
AppSec [baseline] (51.426 ms) : 0, 51426
AppSec [candidate] (53.513 ms) : 0, 53513
Debugger [baseline] (5.995 ms) : 0, 5995
Debugger [candidate] (6.043 ms) : 0, 6043
Remote Config [baseline] (592.282 µs) : 0, 592
Remote Config [candidate] (604.981 µs) : 0, 605
Telemetry [baseline] (7.936 ms) : 0, 7936
Telemetry [candidate] (7.808 ms) : 0, 7808
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1023818
Total [baseline] (11.139 s) : 0, 11138961
Agent [candidate] (1.026 s) : 0, 1025608
Total [candidate] (11.076 s) : 0, 11075676
section appsec
Agent [baseline] (1.161 s) : 0, 1160895
Total [baseline] (11.232 s) : 0, 11231785
Agent [candidate] (1.161 s) : 0, 1161099
Total [candidate] (11.217 s) : 0, 11216518
section iast
Agent [baseline] (1.152 s) : 0, 1151552
Total [baseline] (11.308 s) : 0, 11308244
Agent [candidate] (1.148 s) : 0, 1147837
Total [candidate] (11.371 s) : 0, 11371216
section profiling
Agent [baseline] (1.266 s) : 0, 1266034
Total [baseline] (11.499 s) : 0, 11499257
Agent [candidate] (1.269 s) : 0, 1269424
Total [candidate] (11.462 s) : 0, 11461570
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.306 ms) : 0, 683306
BytebuddyAgent [candidate] (684.369 ms) : 0, 684369
GlobalTracer [baseline] (240.676 ms) : 0, 240676
GlobalTracer [candidate] (240.85 ms) : 0, 240850
AppSec [baseline] (57.241 ms) : 0, 57241
AppSec [candidate] (56.996 ms) : 0, 56996
Debugger [baseline] (6.19 ms) : 0, 6190
Debugger [candidate] (6.176 ms) : 0, 6176
Remote Config [baseline] (725.939 µs) : 0, 726
Remote Config [candidate] (713.09 µs) : 0, 713
Telemetry [baseline] (12.129 ms) : 0, 12129
Telemetry [candidate] (12.896 ms) : 0, 12896
section appsec
BytebuddyAgent [baseline] (699.095 ms) : 0, 699095
BytebuddyAgent [candidate] (699.668 ms) : 0, 699668
GlobalTracer [baseline] (237.038 ms) : 0, 237038
GlobalTracer [candidate] (237.28 ms) : 0, 237280
IAST [baseline] (21.922 ms) : 0, 21922
IAST [candidate] (21.753 ms) : 0, 21753
AppSec [baseline] (176.308 ms) : 0, 176308
AppSec [candidate] (175.747 ms) : 0, 175747
Debugger [baseline] (5.985 ms) : 0, 5985
Debugger [candidate] (5.969 ms) : 0, 5969
Remote Config [baseline] (621.433 µs) : 0, 621
Remote Config [candidate] (629.682 µs) : 0, 630
Telemetry [baseline] (7.383 ms) : 0, 7383
Telemetry [candidate] (7.349 ms) : 0, 7349
section iast
BytebuddyAgent [baseline] (803.181 ms) : 0, 803181
BytebuddyAgent [candidate] (800.236 ms) : 0, 800236
GlobalTracer [baseline] (231.022 ms) : 0, 231022
GlobalTracer [candidate] (230.593 ms) : 0, 230593
IAST [baseline] (28.338 ms) : 0, 28338
IAST [candidate] (27.496 ms) : 0, 27496
AppSec [baseline] (50.973 ms) : 0, 50973
AppSec [candidate] (51.612 ms) : 0, 51612
Debugger [baseline] (5.973 ms) : 0, 5973
Debugger [candidate] (5.966 ms) : 0, 5966
Remote Config [baseline] (586.851 µs) : 0, 587
Remote Config [candidate] (598.119 µs) : 0, 598
Telemetry [baseline] (7.949 ms) : 0, 7949
Telemetry [candidate] (7.907 ms) : 0, 7907
section profiling
BytebuddyAgent [baseline] (674.678 ms) : 0, 674678
BytebuddyAgent [candidate] (676.664 ms) : 0, 676664
GlobalTracer [baseline] (360.526 ms) : 0, 360526
GlobalTracer [candidate] (361.214 ms) : 0, 361214
AppSec [baseline] (61.761 ms) : 0, 61761
AppSec [candidate] (61.829 ms) : 0, 61829
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.104 ms) : 0, 6104
Remote Config [baseline] (644.023 µs) : 0, 644
Remote Config [candidate] (647.231 µs) : 0, 647
Telemetry [baseline] (8.093 ms) : 0, 8093
Telemetry [candidate] (8.105 ms) : 0, 8105
ProfilingAgent [baseline] (103.331 ms) : 0, 103331
ProfilingAgent [candidate] (103.985 ms) : 0, 103985
Profiling [baseline] (103.355 ms) : 0, 103355
Profiling [candidate] (104.008 ms) : 0, 104008
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 0 metrics, 13 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (8.545 ms) : 8523, 8567
. : milestone, 8545,
appsec (62.12 ms) : 61232, 63007
. : milestone, 62120,
appsec_no_iast (70.656 ms) : 69645, 71668
. : milestone, 70656,
code_origins (87.631 ms) : 85881, 89382
. : milestone, 87631,
iast (79.133 ms) : 77833, 80432
. : milestone, 79133,
profiling (52.227 ms) : 51446, 53008
. : milestone, 52227,
tracing (12.982 ms) : 12861, 13104
. : milestone, 12982,
section candidate
no_agent (122.452 ms) : 119472, 125432
. : milestone, 122452,
appsec (135.551 ms) : 131451, 139651
. : milestone, 135551,
appsec_no_iast (138.742 ms) : 133782, 143703
. : milestone, 138742,
code_origins (151.067 ms) : 141445, 160689
. : milestone, 151067,
iast (150.647 ms) : 143893, 157400
. : milestone, 150647,
profiling (134.334 ms) : 130384, 138285
. : milestone, 134334,
tracing (128.847 ms) : 125495, 132199
. : milestone, 128847,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
. : milestone, 1483,
appsec (2.429 ms) : 2379, 2478
. : milestone, 2429,
iast (2.209 ms) : 2147, 2271
. : milestone, 2209,
iast_GLOBAL (2.263 ms) : 2200, 2326
. : milestone, 2263,
profiling (2.039 ms) : 1989, 2088
. : milestone, 2039,
tracing (2.049 ms) : 2000, 2099
. : milestone, 2049,
section candidate
no_agent (1.486 ms) : 1474, 1498
. : milestone, 1486,
appsec (2.433 ms) : 2384, 2483
. : milestone, 2433,
iast (2.214 ms) : 2152, 2276
. : milestone, 2214,
iast_GLOBAL (2.252 ms) : 2190, 2315
. : milestone, 2252,
profiling (2.059 ms) : 2009, 2109
. : milestone, 2059,
tracing (2.03 ms) : 1981, 2078
. : milestone, 2030,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~90ae1ce32f, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (15.474 s) : 15474000, 15474000
. : milestone, 15474000,
appsec (14.63 s) : 14630000, 14630000
. : milestone, 14630000,
iast (18.565 s) : 18565000, 18565000
. : milestone, 18565000,
iast_GLOBAL (18.099 s) : 18099000, 18099000
. : milestone, 18099000,
profiling (15.316 s) : 15316000, 15316000
. : milestone, 15316000,
tracing (14.827 s) : 14827000, 14827000
. : milestone, 14827000,
section candidate
no_agent (15.571 s) : 15571000, 15571000
. : milestone, 15571000,
appsec (14.843 s) : 14843000, 14843000
. : milestone, 14843000,
iast (19.01 s) : 19010000, 19010000
. : milestone, 19010000,
iast_GLOBAL (18.17 s) : 18170000, 18170000
. : milestone, 18170000,
profiling (15.138 s) : 15138000, 15138000
. : milestone, 15138000,
tracing (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Remove ubuntu17 from test variants
Motivation
This variant was used by profiling to test against with a JVM without debug symbols.
It is now tested of the profiling product side.
Additional Notes
See DataDog/dd-trace-java-docker-build#103
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]