Skip to content

Fix flaky Gradle Daemon instrumentation smoke test #8955

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jun 10, 2025
Merged

Fix flaky Gradle Daemon instrumentation smoke test #8955

merged 3 commits into from
Jun 10, 2025
+12 −7

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Jun 10, 2025 •
edited
Loading

What Does This Do

Fixes flaky Gradle Daemon instrumentation test: test-succeed-gradle-plugin-test.

Motivation

This test case is different from the others because the instrumented project builds a Gradle plugin and uses Gradle Test Kit to test it.
There was an issue where our Gradle Launcher instrumentation interfered with Gradle Test Kit, and this test case was added to ensure the issue does not reappear.

The test inside the instrumented project runs a Gradle build. So we have three nested Gradle builds:

  • the "outermost" build of the tracer (run with whatever Gradle version is used to build the tracer at the moment)
  • the build that is run by smoke test (run with Gradle Test Kit and uses Gradle version that is specified in the smoke test case)
  • the "innermost" build that is triggered as part of running the tests in the sample project (run with Gradle Test Kit and uses Gradle version that is specified in the sample project's testcase)

If the Gradle version used by Gradle Test Kit is not available locally, the test kit downloads it.
These Gradle downloads sometimes fail.
In the case of this flaky test the download that fails is of the Gradle distribution needed to run the "innermost" build.

In the smoke test itself ("middle" nested build) we solve it by having a custom download logic with extended timeout and retries.

The fix is to update the test inside the sample project to use the same Gradle version that is used to run the project itself (Gradle version is propagated from the smoke test with an env var).
As that Gradle distribution is already available locally, the test will not try to redownload it.

N.B. All downloads are stored under ~/.gradle/wrapper/.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 10, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 10, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-plugin-smoke-test-flaky-fix
git_commit_date 1749044153 1749567014
git_commit_sha 7787af7 af4a98d
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~af4a98d9e1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749569393 1749569393
ci_job_id 975374215 975374215
ci_pipeline_id 67377528 67377528
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-0-qfhkhf26 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-0-qfhkhf26 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1023002
Total [baseline] (8.515 s) : 0, 8514952
Agent [candidate] (1.025 s) : 0, 1024591
Total [candidate] (8.561 s) : 0, 8561332
section iast
Agent [baseline] (1.151 s) : 0, 1150981
Total [baseline] (9.148 s) : 0, 9148127
Agent [candidate] (1.151 s) : 0, 1150966
Total [candidate] (9.159 s) : 0, 9159101
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.158 s) : 0, 1158276
Total [baseline] (9.171 s) : 0, 9170847
Agent [candidate] (1.152 s) : 0, 1152420
Total [candidate] (9.114 s) : 0, 9113520
section iast_TELEMETRY_OFF
Agent [baseline] (1.15 s) : 0, 1149932
Total [baseline] (9.184 s) : 0, 9184261
Agent [candidate] (1.158 s) : 0, 1158292
Total [candidate] (9.201 s) : 0, 9200677
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.151 s 127.979 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 135.274 ms (13.2%)
Agent iast_TELEMETRY_OFF 1.15 s 126.93 ms (12.4%)
Total tracing 8.515 s -
Total iast 9.148 s 633.175 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.171 s 655.896 ms (7.7%)
Total iast_TELEMETRY_OFF 9.184 s 669.31 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent iast 1.151 s 126.375 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.152 s 127.829 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.158 s 133.701 ms (13.0%)
Total tracing 8.561 s -
Total iast 9.159 s 597.77 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.114 s 552.189 ms (6.4%)
Total iast_TELEMETRY_OFF 9.201 s 639.346 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.159 ms) : 0, 683159
BytebuddyAgent [candidate] (684.037 ms) : 0, 684037
GlobalTracer [baseline] (239.497 ms) : 0, 239497
GlobalTracer [candidate] (242.018 ms) : 0, 242018
AppSec [baseline] (56.979 ms) : 0, 56979
AppSec [candidate] (56.671 ms) : 0, 56671
Debugger [baseline] (6.207 ms) : 0, 6207
Debugger [candidate] (6.218 ms) : 0, 6218
Remote Config [baseline] (733.225 µs) : 0, 733
Remote Config [candidate] (747.517 µs) : 0, 748
Telemetry [baseline] (12.854 ms) : 0, 12854
Telemetry [candidate] (11.333 ms) : 0, 11333
section iast
BytebuddyAgent [baseline] (802.507 ms) : 0, 802507
BytebuddyAgent [candidate] (802.958 ms) : 0, 802958
GlobalTracer [baseline] (230.665 ms) : 0, 230665
GlobalTracer [candidate] (231.093 ms) : 0, 231093
IAST [baseline] (25.416 ms) : 0, 25416
IAST [candidate] (26.88 ms) : 0, 26880
AppSec [baseline] (54.208 ms) : 0, 54208
AppSec [candidate] (52.123 ms) : 0, 52123
Debugger [baseline] (6.019 ms) : 0, 6019
Debugger [candidate] (5.901 ms) : 0, 5901
Remote Config [baseline] (599.148 µs) : 0, 599
Remote Config [candidate] (601.29 µs) : 0, 601
Telemetry [baseline] (7.942 ms) : 0, 7942
Telemetry [candidate] (7.916 ms) : 0, 7916
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.711 ms) : 0, 807711
BytebuddyAgent [candidate] (803.197 ms) : 0, 803197
GlobalTracer [baseline] (231.928 ms) : 0, 231928
GlobalTracer [candidate] (231.263 ms) : 0, 231263
IAST [baseline] (27.539 ms) : 0, 27539
IAST [candidate] (25.58 ms) : 0, 25580
AppSec [baseline] (52.102 ms) : 0, 52102
AppSec [candidate] (54.209 ms) : 0, 54209
Debugger [baseline] (5.998 ms) : 0, 5998
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (598.07 µs) : 0, 598
Remote Config [candidate] (602.904 µs) : 0, 603
Telemetry [baseline] (7.973 ms) : 0, 7973
Telemetry [candidate] (7.972 ms) : 0, 7972
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (800.883 ms) : 0, 800883
BytebuddyAgent [candidate] (807.381 ms) : 0, 807381
GlobalTracer [baseline] (231.515 ms) : 0, 231515
GlobalTracer [candidate] (233.054 ms) : 0, 233054
IAST [baseline] (27.437 ms) : 0, 27437
IAST [candidate] (28.915 ms) : 0, 28915
AppSec [baseline] (52.061 ms) : 0, 52061
AppSec [candidate] (50.689 ms) : 0, 50689
Debugger [baseline] (6.021 ms) : 0, 6021
Debugger [candidate] (6.013 ms) : 0, 6013
Remote Config [baseline] (590.462 µs) : 0, 590
Remote Config [candidate] (602.421 µs) : 0, 602
Telemetry [baseline] (7.86 ms) : 0, 7860
Telemetry [candidate] (7.921 ms) : 0, 7921
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1031767
Total [baseline] (11.169 s) : 0, 11168864
Agent [candidate] (1.03 s) : 0, 1029566
Total [candidate] (11.113 s) : 0, 11112806
section appsec
Agent [baseline] (1.167 s) : 0, 1166631
Total [baseline] (11.179 s) : 0, 11179033
Agent [candidate] (1.168 s) : 0, 1168318
Total [candidate] (11.221 s) : 0, 11221449
section iast
Agent [baseline] (1.175 s) : 0, 1175426
Total [baseline] (11.339 s) : 0, 11338586
Agent [candidate] (1.173 s) : 0, 1172858
Total [candidate] (11.374 s) : 0, 11373534
section profiling
Agent [baseline] (1.273 s) : 0, 1272634
Total [baseline] (11.446 s) : 0, 11446185
Agent [candidate] (1.27 s) : 0, 1270301
Total [candidate] (11.465 s) : 0, 11465405
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent appsec 1.167 s 134.864 ms (13.1%)
Agent iast 1.175 s 143.659 ms (13.9%)
Agent profiling 1.273 s 240.868 ms (23.3%)
Total tracing 11.169 s -
Total appsec 11.179 s 10.168 ms (0.1%)
Total iast 11.339 s 169.721 ms (1.5%)
Total profiling 11.446 s 277.321 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent appsec 1.168 s 138.752 ms (13.5%)
Agent iast 1.173 s 143.291 ms (13.9%)
Agent profiling 1.27 s 240.735 ms (23.4%)
Total tracing 11.113 s -
Total appsec 11.221 s 108.642 ms (1.0%)
Total iast 11.374 s 260.728 ms (2.3%)
Total profiling 11.465 s 352.599 ms (3.2%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.943 ms) : 0, 688943
BytebuddyAgent [candidate] (688.361 ms) : 0, 688361
GlobalTracer [baseline] (241.738 ms) : 0, 241738
GlobalTracer [candidate] (242.242 ms) : 0, 242242
AppSec [baseline] (56.005 ms) : 0, 56005
AppSec [candidate] (57.746 ms) : 0, 57746
Debugger [baseline] (6.219 ms) : 0, 6219
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (737.595 µs) : 0, 738
Remote Config [candidate] (721.191 µs) : 0, 721
Telemetry [baseline] (14.357 ms) : 0, 14357
Telemetry [candidate] (10.503 ms) : 0, 10503
section appsec
BytebuddyAgent [baseline] (703.54 ms) : 0, 703540
BytebuddyAgent [candidate] (704.139 ms) : 0, 704139
GlobalTracer [baseline] (238.532 ms) : 0, 238532
GlobalTracer [candidate] (238.971 ms) : 0, 238971
IAST [baseline] (21.862 ms) : 0, 21862
IAST [candidate] (21.968 ms) : 0, 21968
AppSec [baseline] (175.96 ms) : 0, 175960
AppSec [candidate] (176.596 ms) : 0, 176596
Debugger [baseline] (5.969 ms) : 0, 5969
Debugger [candidate] (5.967 ms) : 0, 5967
Remote Config [baseline] (637.57 µs) : 0, 638
Remote Config [candidate] (620.986 µs) : 0, 621
Telemetry [baseline] (7.395 ms) : 0, 7395
Telemetry [candidate] (7.394 ms) : 0, 7394
section iast
BytebuddyAgent [baseline] (820.472 ms) : 0, 820472
BytebuddyAgent [candidate] (818.547 ms) : 0, 818547
GlobalTracer [baseline] (235.017 ms) : 0, 235017
GlobalTracer [candidate] (234.333 ms) : 0, 234333
IAST [baseline] (26.087 ms) : 0, 26087
IAST [candidate] (28.334 ms) : 0, 28334
AppSec [baseline] (55.158 ms) : 0, 55158
AppSec [candidate] (52.916 ms) : 0, 52916
Debugger [baseline] (6.021 ms) : 0, 6021
Debugger [candidate] (6.038 ms) : 0, 6038
Remote Config [baseline] (621.643 µs) : 0, 622
Remote Config [candidate] (612.841 µs) : 0, 613
Telemetry [baseline] (8.02 ms) : 0, 8020
Telemetry [candidate] (8.125 ms) : 0, 8125
section profiling
BytebuddyAgent [baseline] (679.256 ms) : 0, 679256
BytebuddyAgent [candidate] (679.449 ms) : 0, 679449
GlobalTracer [baseline] (361.452 ms) : 0, 361452
GlobalTracer [candidate] (360.49 ms) : 0, 360490
AppSec [baseline] (61.879 ms) : 0, 61879
AppSec [candidate] (61.46 ms) : 0, 61460
Debugger [baseline] (6.156 ms) : 0, 6156
Debugger [candidate] (6.045 ms) : 0, 6045
Remote Config [baseline] (690.694 µs) : 0, 691
Remote Config [candidate] (664.053 µs) : 0, 664
Telemetry [baseline] (8.244 ms) : 0, 8244
Telemetry [candidate] (8.07 ms) : 0, 8070
ProfilingAgent [baseline] (103.919 ms) : 0, 103919
ProfilingAgent [candidate] (102.847 ms) : 0, 102847
Profiling [baseline] (103.944 ms) : 0, 103944
Profiling [candidate] (102.87 ms) : 0, 102870
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-10T15:08:05 2025-06-10T15:13:25
error dial: connection refused -
error_code 1212 -
git_branch master nikita-tkachenko/gradle-plugin-smoke-test-flaky-fix
git_commit_date 1749044153 1749567014
git_commit_sha 7787af7 af4a98d
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~af4a98d9e1
start_time 2025-06-10T15:08:02 2025-06-10T15:12:34
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749568405 1749568405
ci_job_id 975374216 975374216
ci_pipeline_id 67377528 67377528
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-1-upmtnk0k 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-1-upmtnk0k 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 0 metrics, 9 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec worse
[+70.078ms; +72.833ms] or [+inf%; +inf%]		 unstable
[-21592.253op/s; -18272.516op/s] or [-107.961%; -91.363%]		 71455741.891ns 67.615op/s 0.000ns 20000.000op/s
scenario:load:petclinic:appsec_no_iast worse
[+74.990ms; +78.503ms] or [+inf%; +inf%]		 unstable
[-23503.240op/s; -8371.683op/s] or [-146.895%; -52.323%]		 76746923.258ns 62.538op/s 0.000ns 16000.000op/s
scenario:load:petclinic:iast unstable
[+67.772ms; +72.362ms] or [+619.365%; +661.307%]		 worse
[-411.268op/s; -376.990op/s] or [-90.831%; -83.261%]		 81.009ms 58.654op/s 10.942ms 452.783op/s
scenario:load:petclinic:no_agent unstable
[+38.620ms; +40.069ms] or [+433.273%; +449.527%]		 worse
[-468.147op/s; -431.836op/s] or [-84.852%; -78.270%]		 48.258ms 101.733op/s 8.914ms 551.724op/s
scenario:load:petclinic:profiling unstable
[+53.906ms; +56.076ms] or [+635.891%; +661.487%]		 worse
[-518.645op/s; -493.770op/s] or [-88.818%; -84.558%]		 63.468ms 77.734op/s 8.477ms 583.942op/s

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-plugin-smoke-test-flaky-fix
git_commit_date 1749044153 1749567014
git_commit_sha 7787af7 af4a98d
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~af4a98d9e1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749568946 1749568946
ci_job_id 975374217 975374217
ci_pipeline_id 67377528 67377528
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-pz8nwqvr-project-304-concurrent-0-p5wg20y6 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-pz8nwqvr-project-304-concurrent-0-p5wg20y6 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.099 s) : 15099000, 15099000
.   : milestone, 15099000,
appsec (14.832 s) : 14832000, 14832000
.   : milestone, 14832000,
iast (18.488 s) : 18488000, 18488000
.   : milestone, 18488000,
iast_GLOBAL (18.203 s) : 18203000, 18203000
.   : milestone, 18203000,
profiling (15.301 s) : 15301000, 15301000
.   : milestone, 15301000,
tracing (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
section candidate
no_agent (15.26 s) : 15260000, 15260000
.   : milestone, 15260000,
appsec (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
iast (18.581 s) : 18581000, 18581000
.   : milestone, 18581000,
iast_GLOBAL (17.848 s) : 17848000, 17848000
.   : milestone, 17848000,
profiling (15.15 s) : 15150000, 15150000
.   : milestone, 15150000,
tracing (14.848 s) : 14848000, 14848000
.   : milestone, 14848000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.099 s [15.099 s, 15.099 s] -
appsec 14.832 s [14.832 s, 14.832 s] -267.0 ms (-1.8%)
iast 18.488 s [18.488 s, 18.488 s] 3.389 s (22.4%)
iast_GLOBAL 18.203 s [18.203 s, 18.203 s] 3.104 s (20.6%)
profiling 15.301 s [15.301 s, 15.301 s] 202.0 ms (1.3%)
tracing 14.8 s [14.8 s, 14.8 s] -299.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.26 s [15.26 s, 15.26 s] -
appsec 14.916 s [14.916 s, 14.916 s] -344.0 ms (-2.3%)
iast 18.581 s [18.581 s, 18.581 s] 3.321 s (21.8%)
iast_GLOBAL 17.848 s [17.848 s, 17.848 s] 2.588 s (17.0%)
profiling 15.15 s [15.15 s, 15.15 s] -110.0 ms (-0.7%)
tracing 14.848 s [14.848 s, 14.848 s] -412.0 ms (-2.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~af4a98d9e1, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (2.404 ms) : 2355, 2453
.   : milestone, 2404,
iast (2.198 ms) : 2136, 2259
.   : milestone, 2198,
iast_GLOBAL (2.228 ms) : 2166, 2289
.   : milestone, 2228,
profiling (2.056 ms) : 2004, 2107
.   : milestone, 2056,
tracing (2.001 ms) : 1953, 2049
.   : milestone, 2001,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.401 ms) : 2352, 2450
.   : milestone, 2401,
iast (2.184 ms) : 2123, 2246
.   : milestone, 2184,
iast_GLOBAL (2.233 ms) : 2171, 2295
.   : milestone, 2233,
profiling (2.048 ms) : 1998, 2098
.   : milestone, 2048,
tracing (2.018 ms) : 1970, 2066
.   : milestone, 2018,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 2.404 ms [2.355 ms, 2.453 ms] 926.585 µs (62.7%)
iast 2.198 ms [2.136 ms, 2.259 ms] 720.271 µs (48.8%)
iast_GLOBAL 2.228 ms [2.166 ms, 2.289 ms] 750.223 µs (50.8%)
profiling 2.056 ms [2.004 ms, 2.107 ms] 578.546 µs (39.2%)
tracing 2.001 ms [1.953 ms, 2.049 ms] 523.723 µs (35.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.401 ms [2.352 ms, 2.45 ms] 928.775 µs (63.1%)
iast 2.184 ms [2.123 ms, 2.246 ms] 711.867 µs (48.4%)
iast_GLOBAL 2.233 ms [2.171 ms, 2.295 ms] 761.068 µs (51.7%)
profiling 2.048 ms [1.998 ms, 2.098 ms] 575.931 µs (39.1%)
tracing 2.018 ms [1.97 ms, 2.066 ms] 545.796 µs (37.1%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review June 10, 2025 16:36
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner June 10, 2025 16:36
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 3853c65 into master Jun 10, 2025
520 of 521 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/gradle-plugin-smoke-test-flaky-fix branch June 10, 2025 16:37
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 10, 2025
@bric3 bric3 mentioned this pull request Jun 11, 2025
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bric3 bric3 bric3 approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@daniel-mohedano daniel-mohedano Awaiting requested review from daniel-mohedano daniel-mohedano is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
3 participants
@nikita-tkachenko-datadog @bric3 @AlexeyKuznetsov-DD