Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Gradle dependencies #7875

Merged
merged 2 commits into from
Nov 4, 2024
Merged

Update Gradle dependencies #7875

merged 2 commits into from
Nov 4, 2024

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Nov 3, 2024

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Nov 3, 2024
@github-actions github-actions bot requested review from a team as code owners November 3, 2024 04:18
@pr-commenter
Copy link

pr-commenter bot commented Nov 3, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241103
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1730610067 1730610067
ci_job_id 693385995 693385995
ci_pipeline_id 48107860 48107860
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
git_commit_date 1730486404 1730486404
git_commit_sha d46416d d46416d
module Agent Agent
parent None None
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~d46416d5b6
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.587 s) : 0, 1587343
Total [baseline] (11.916 s) : 0, 11916128
Agent [candidate] (1.597 s) : 0, 1596518
Total [candidate] (11.959 s) : 0, 11958903
section iast
Agent [baseline] (1.757 s) : 0, 1757480
Total [baseline] (12.821 s) : 0, 12821041
Agent [candidate] (1.757 s) : 0, 1757228
Total [candidate] (12.834 s) : 0, 12834444
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.755 s) : 0, 1755155
Total [baseline] (12.765 s) : 0, 12764739
Agent [candidate] (1.761 s) : 0, 1761424
Total [candidate] (12.806 s) : 0, 12806364
section iast_TELEMETRY_OFF
Agent [baseline] (1.751 s) : 0, 1751425
Total [baseline] (12.843 s) : 0, 12843490
Agent [candidate] (1.756 s) : 0, 1755838
Total [candidate] (12.796 s) : 0, 12795505
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.587 s -
Agent iast 1.757 s 170.137 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.755 s 167.811 ms (10.6%)
Agent iast_TELEMETRY_OFF 1.751 s 164.082 ms (10.3%)
Total tracing 11.916 s -
Total iast 12.821 s 904.913 ms (7.6%)
Total iast_HARDCODED_SECRET_DISABLED 12.765 s 848.611 ms (7.1%)
Total iast_TELEMETRY_OFF 12.843 s 927.362 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.597 s -
Agent iast 1.757 s 160.711 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.761 s 164.906 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.756 s 159.32 ms (10.0%)
Total tracing 11.959 s -
Total iast 12.834 s 875.54 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 12.806 s 847.46 ms (7.1%)
Total iast_TELEMETRY_OFF 12.796 s 836.601 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.016 s) : 0, 1015709
BytebuddyAgent [candidate] (1.02 s) : 0, 1019625
GlobalTracer [baseline] (464.389 ms) : 0, 464389
GlobalTracer [candidate] (467.845 ms) : 0, 467845
AppSec [baseline] (75.539 ms) : 0, 75539
AppSec [candidate] (75.769 ms) : 0, 75769
Remote Config [baseline] (817.545 µs) : 0, 818
Remote Config [candidate] (820.534 µs) : 0, 821
Telemetry [baseline] (10.703 ms) : 0, 10703
Telemetry [candidate] (12.134 ms) : 0, 12134
section iast
BytebuddyAgent [baseline] (1.178 s) : 0, 1178130
BytebuddyAgent [candidate] (1.178 s) : 0, 1177672
GlobalTracer [baseline] (443.737 ms) : 0, 443737
GlobalTracer [candidate] (444.497 ms) : 0, 444497
AppSec [baseline] (77.379 ms) : 0, 77379
AppSec [candidate] (77.755 ms) : 0, 77755
Remote Config [baseline] (771.554 µs) : 0, 772
Remote Config [candidate] (756.497 µs) : 0, 756
Telemetry [baseline] (9.61 ms) : 0, 9610
Telemetry [candidate] (9.563 ms) : 0, 9563
IAST [baseline] (27.66 ms) : 0, 27660
IAST [candidate] (26.761 ms) : 0, 26761
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.174 s) : 0, 1174199
BytebuddyAgent [candidate] (1.18 s) : 0, 1179882
GlobalTracer [baseline] (444.938 ms) : 0, 444938
GlobalTracer [candidate] (445.762 ms) : 0, 445762
AppSec [baseline] (76.984 ms) : 0, 76984
AppSec [candidate] (77.688 ms) : 0, 77688
Remote Config [baseline] (746.049 µs) : 0, 746
Remote Config [candidate] (739.838 µs) : 0, 740
Telemetry [baseline] (9.655 ms) : 0, 9655
Telemetry [candidate] (9.628 ms) : 0, 9628
IAST [baseline] (28.468 ms) : 0, 28468
IAST [candidate] (27.413 ms) : 0, 27413
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.173 s) : 0, 1172539
BytebuddyAgent [candidate] (1.176 s) : 0, 1175689
GlobalTracer [baseline] (443.744 ms) : 0, 443744
GlobalTracer [candidate] (444.445 ms) : 0, 444445
AppSec [baseline] (78.603 ms) : 0, 78603
AppSec [candidate] (76.133 ms) : 0, 76133
Remote Config [baseline] (763.767 µs) : 0, 764
Remote Config [candidate] (748.034 µs) : 0, 748
Telemetry [baseline] (9.469 ms) : 0, 9469
Telemetry [candidate] (10.346 ms) : 0, 10346
IAST [baseline] (26.139 ms) : 0, 26139
IAST [candidate] (28.175 ms) : 0, 28175
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.59 s) : 0, 1589599
Total [baseline] (14.387 s) : 0, 14386615
Agent [candidate] (1.588 s) : 0, 1588406
Total [candidate] (14.366 s) : 0, 14366190
section appsec
Agent [baseline] (1.787 s) : 0, 1786580
Total [baseline] (14.663 s) : 0, 14662599
Agent [candidate] (1.797 s) : 0, 1797079
Total [candidate] (14.678 s) : 0, 14677592
section iast
Agent [baseline] (1.762 s) : 0, 1761568
Total [baseline] (15.018 s) : 0, 15018358
Agent [candidate] (1.766 s) : 0, 1765819
Total [candidate] (15.093 s) : 0, 15093033
section profiling
Agent [baseline] (1.913 s) : 0, 1912643
Total [baseline] (14.739 s) : 0, 14739266
Agent [candidate] (1.92 s) : 0, 1920282
Total [candidate] (14.704 s) : 0, 14703724
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.59 s -
Agent appsec 1.787 s 196.981 ms (12.4%)
Agent iast 1.762 s 171.969 ms (10.8%)
Agent profiling 1.913 s 323.044 ms (20.3%)
Total tracing 14.387 s -
Total appsec 14.663 s 275.984 ms (1.9%)
Total iast 15.018 s 631.744 ms (4.4%)
Total profiling 14.739 s 352.652 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.588 s -
Agent appsec 1.797 s 208.672 ms (13.1%)
Agent iast 1.766 s 177.413 ms (11.2%)
Agent profiling 1.92 s 331.876 ms (20.9%)
Total tracing 14.366 s -
Total appsec 14.678 s 311.403 ms (2.2%)
Total iast 15.093 s 726.843 ms (5.1%)
Total profiling 14.704 s 337.534 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.017 s) : 0, 1016603
BytebuddyAgent [candidate] (1.015 s) : 0, 1015241
GlobalTracer [baseline] (465.006 ms) : 0, 465006
GlobalTracer [candidate] (465.083 ms) : 0, 465083
AppSec [baseline] (75.499 ms) : 0, 75499
AppSec [candidate] (75.627 ms) : 0, 75627
Remote Config [baseline] (822.629 µs) : 0, 823
Remote Config [candidate] (818.433 µs) : 0, 818
Telemetry [baseline] (11.445 ms) : 0, 11445
Telemetry [candidate] (11.381 ms) : 0, 11381
section appsec
BytebuddyAgent [baseline] (1.038 s) : 0, 1038230
BytebuddyAgent [candidate] (1.044 s) : 0, 1044253
GlobalTracer [baseline] (460.763 ms) : 0, 460763
GlobalTracer [candidate] (463.339 ms) : 0, 463339
AppSec [baseline] (242.857 ms) : 0, 242857
AppSec [candidate] (244.855 ms) : 0, 244855
Remote Config [baseline] (779.067 µs) : 0, 779
Remote Config [candidate] (799.123 µs) : 0, 799
Telemetry [baseline] (10.273 ms) : 0, 10273
Telemetry [candidate] (9.97 ms) : 0, 9970
IAST [baseline] (27.092 ms) : 0, 27092
IAST [candidate] (27.118 ms) : 0, 27118
section iast
BytebuddyAgent [baseline] (1.182 s) : 0, 1182373
BytebuddyAgent [candidate] (1.183 s) : 0, 1183269
GlobalTracer [baseline] (443.852 ms) : 0, 443852
GlobalTracer [candidate] (446.512 ms) : 0, 446512
AppSec [baseline] (77.135 ms) : 0, 77135
AppSec [candidate] (76.565 ms) : 0, 76565
Remote Config [baseline] (765.081 µs) : 0, 765
Remote Config [candidate] (765.256 µs) : 0, 765
Telemetry [baseline] (9.605 ms) : 0, 9605
Telemetry [candidate] (9.592 ms) : 0, 9592
IAST [baseline] (27.615 ms) : 0, 27615
IAST [candidate] (28.802 ms) : 0, 28802
section profiling
BytebuddyAgent [baseline] (1.008 s) : 0, 1007828
BytebuddyAgent [candidate] (1.011 s) : 0, 1011463
GlobalTracer [baseline] (595.48 ms) : 0, 595480
GlobalTracer [candidate] (595.348 ms) : 0, 595348
AppSec [baseline] (76.096 ms) : 0, 76096
AppSec [candidate] (76.195 ms) : 0, 76195
Remote Config [baseline] (842.036 µs) : 0, 842
Remote Config [candidate] (841.723 µs) : 0, 842
Telemetry [baseline] (13.911 ms) : 0, 13911
Telemetry [candidate] (13.125 ms) : 0, 13125
ProfilingAgent [baseline] (160.827 ms) : 0, 160827
ProfilingAgent [candidate] (165.299 ms) : 0, 165299
Profiling [baseline] (160.882 ms) : 0, 160882
Profiling [candidate] (165.354 ms) : 0, 165354
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-03T04:19:55 2024-11-03T04:29:03
git_branch master ci/update-gradle-dependencies-20241103
start_time 2024-11-03T04:19:39 2024-11-03T04:28:47
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1730608607 1730608607
ci_job_id 693385996 693385996
ci_pipeline_id 48107860 48107860
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
git_commit_date 1730486404 1730486404
git_commit_sha d46416d d46416d
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~d46416d5b6
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 7 metrics, 21 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (454.619 µs) : 426, 483
.   : milestone, 455,
iast (586.798 µs) : 555, 618
.   : milestone, 587,
iast_FULL (831.079 µs) : 798, 864
.   : milestone, 831,
iast_GLOBAL (621.104 µs) : 590, 652
.   : milestone, 621,
iast_HARDCODED_SECRET_DISABLED (590.953 µs) : 558, 624
.   : milestone, 591,
iast_INACTIVE (536.167 µs) : 506, 567
.   : milestone, 536,
iast_TELEMETRY_OFF (571.53 µs) : 539, 604
.   : milestone, 572,
tracing (535.834 µs) : 506, 566
.   : milestone, 536,
section candidate
no_agent (449.003 µs) : 420, 478
.   : milestone, 449,
iast (590.119 µs) : 557, 623
.   : milestone, 590,
iast_FULL (837.083 µs) : 804, 870
.   : milestone, 837,
iast_GLOBAL (622.251 µs) : 589, 655
.   : milestone, 622,
iast_HARDCODED_SECRET_DISABLED (578.643 µs) : 546, 611
.   : milestone, 579,
iast_INACTIVE (541.374 µs) : 511, 572
.   : milestone, 541,
iast_TELEMETRY_OFF (573.094 µs) : 541, 605
.   : milestone, 573,
tracing (529.564 µs) : 498, 561
.   : milestone, 530,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 454.619 µs [425.901 µs, 483.337 µs] -
iast 586.798 µs [555.474 µs, 618.123 µs] 132.18 µs (29.1%)
iast_FULL 831.079 µs [798.044 µs, 864.114 µs] 376.461 µs (82.8%)
iast_GLOBAL 621.104 µs [589.796 µs, 652.412 µs] 166.485 µs (36.6%)
iast_HARDCODED_SECRET_DISABLED 590.953 µs [558.31 µs, 623.596 µs] 136.334 µs (30.0%)
iast_INACTIVE 536.167 µs [505.715 µs, 566.62 µs] 81.549 µs (17.9%)
iast_TELEMETRY_OFF 571.53 µs [539.239 µs, 603.822 µs] 116.912 µs (25.7%)
tracing 535.834 µs [505.894 µs, 565.774 µs] 81.216 µs (17.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 449.003 µs [420.418 µs, 477.587 µs] -
iast 590.119 µs [557.192 µs, 623.045 µs] 141.116 µs (31.4%)
iast_FULL 837.083 µs [804.251 µs, 869.915 µs] 388.08 µs (86.4%)
iast_GLOBAL 622.251 µs [589.363 µs, 655.138 µs] 173.248 µs (38.6%)
iast_HARDCODED_SECRET_DISABLED 578.643 µs [546.126 µs, 611.159 µs] 129.64 µs (28.9%)
iast_INACTIVE 541.374 µs [510.603 µs, 572.146 µs] 92.372 µs (20.6%)
iast_TELEMETRY_OFF 573.094 µs [540.713 µs, 605.475 µs] 124.092 µs (27.6%)
tracing 529.564 µs [498.398 µs, 560.731 µs] 80.562 µs (17.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.712 ms) : 1687, 1737
.   : milestone, 1712,
appsec (2.195 ms) : 2164, 2226
.   : milestone, 2195,
appsec_no_iast (2.176 ms) : 2144, 2207
.   : milestone, 2176,
iast (1.903 ms) : 1872, 1933
.   : milestone, 1903,
profiling (1.942 ms) : 1906, 1978
.   : milestone, 1942,
tracing (1.869 ms) : 1837, 1900
.   : milestone, 1869,
section candidate
no_agent (1.71 ms) : 1685, 1735
.   : milestone, 1710,
appsec (2.193 ms) : 2163, 2223
.   : milestone, 2193,
appsec_no_iast (2.195 ms) : 2163, 2226
.   : milestone, 2195,
iast (1.884 ms) : 1854, 1914
.   : milestone, 1884,
profiling (1.952 ms) : 1902, 2002
.   : milestone, 1952,
tracing (1.872 ms) : 1842, 1903
.   : milestone, 1872,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.712 ms [1.687 ms, 1.737 ms] -
appsec 2.195 ms [2.164 ms, 2.226 ms] 482.394 µs (28.2%)
appsec_no_iast 2.176 ms [2.144 ms, 2.207 ms] 463.256 µs (27.1%)
iast 1.903 ms [1.872 ms, 1.933 ms] 190.143 µs (11.1%)
profiling 1.942 ms [1.906 ms, 1.978 ms] 229.4 µs (13.4%)
tracing 1.869 ms [1.837 ms, 1.9 ms] 156.324 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.71 ms [1.685 ms, 1.735 ms] -
appsec 2.193 ms [2.163 ms, 2.223 ms] 482.491 µs (28.2%)
appsec_no_iast 2.195 ms [2.163 ms, 2.226 ms] 484.523 µs (28.3%)
iast 1.884 ms [1.854 ms, 1.914 ms] 173.595 µs (10.1%)
profiling 1.952 ms [1.902 ms, 2.002 ms] 241.822 µs (14.1%)
tracing 1.872 ms [1.842 ms, 1.903 ms] 162.17 µs (9.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241103
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1730608819 1730608819
ci_job_id 693385997 693385997
ci_pipeline_id 48107860 48107860
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1730486404 1730486404
git_commit_sha d46416d d46416d
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~d46416d5b6
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.349 ms) : 2308, 2391
.   : milestone, 2349,
iast (2.083 ms) : 2031, 2136
.   : milestone, 2083,
iast_GLOBAL (2.132 ms) : 2079, 2184
.   : milestone, 2132,
profiling (1.967 ms) : 1922, 2011
.   : milestone, 1967,
tracing (1.92 ms) : 1881, 1960
.   : milestone, 1920,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.361 ms) : 2320, 2403
.   : milestone, 2361,
iast (2.085 ms) : 2033, 2137
.   : milestone, 2085,
iast_GLOBAL (2.143 ms) : 2090, 2196
.   : milestone, 2143,
profiling (1.952 ms) : 1910, 1994
.   : milestone, 1952,
tracing (1.943 ms) : 1903, 1983
.   : milestone, 1943,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.349 ms [2.308 ms, 2.391 ms] 870.14 µs (58.8%)
iast 2.083 ms [2.031 ms, 2.136 ms] 604.173 µs (40.8%)
iast_GLOBAL 2.132 ms [2.079 ms, 2.184 ms] 652.261 µs (44.1%)
profiling 1.967 ms [1.922 ms, 2.011 ms] 487.408 µs (32.9%)
tracing 1.92 ms [1.881 ms, 1.96 ms] 440.898 µs (29.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.361 ms [2.32 ms, 2.403 ms] 881.608 µs (59.6%)
iast 2.085 ms [2.033 ms, 2.137 ms] 604.926 µs (40.9%)
iast_GLOBAL 2.143 ms [2.09 ms, 2.196 ms] 663.441 µs (44.8%)
profiling 1.952 ms [1.91 ms, 1.994 ms] 472.083 µs (31.9%)
tracing 1.943 ms [1.903 ms, 1.983 ms] 463.394 µs (31.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~d46416d5b6, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.131 s) : 15131000, 15131000
.   : milestone, 15131000,
appsec (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
iast (19.236 s) : 19236000, 19236000
.   : milestone, 19236000,
iast_GLOBAL (18.246 s) : 18246000, 18246000
.   : milestone, 18246000,
profiling (14.938 s) : 14938000, 14938000
.   : milestone, 14938000,
tracing (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
section candidate
no_agent (15.354 s) : 15354000, 15354000
.   : milestone, 15354000,
appsec (15.069 s) : 15069000, 15069000
.   : milestone, 15069000,
iast (18.645 s) : 18645000, 18645000
.   : milestone, 18645000,
iast_GLOBAL (18.392 s) : 18392000, 18392000
.   : milestone, 18392000,
profiling (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
tracing (15.243 s) : 15243000, 15243000
.   : milestone, 15243000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.131 s [15.131 s, 15.131 s] -
appsec 15.165 s [15.165 s, 15.165 s] 34.0 ms (0.2%)
iast 19.236 s [19.236 s, 19.236 s] 4.105 s (27.1%)
iast_GLOBAL 18.246 s [18.246 s, 18.246 s] 3.115 s (20.6%)
profiling 14.938 s [14.938 s, 14.938 s] -193.0 ms (-1.3%)
tracing 15.165 s [15.165 s, 15.165 s] 34.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.354 s [15.354 s, 15.354 s] -
appsec 15.069 s [15.069 s, 15.069 s] -285.0 ms (-1.9%)
iast 18.645 s [18.645 s, 18.645 s] 3.291 s (21.4%)
iast_GLOBAL 18.392 s [18.392 s, 18.392 s] 3.038 s (19.8%)
profiling 14.888 s [14.888 s, 14.888 s] -466.0 ms (-3.0%)
tracing 15.243 s [15.243 s, 15.243 s] -111.0 ms (-0.7%)

@pr-commenter
Copy link

pr-commenter bot commented Nov 3, 2024

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241103
git_commit_date 1730486404 1730607506
git_commit_sha d46416d ecf1f2b
See matching parameters
Baseline Candidate
ci_job_date 1730608581 1730608581
ci_job_id 693387601 693387601
ci_pipeline_id 48108546 48108546
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 1 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-54373.170op/s; -47196.170op/s] or [-31.601%; -27.430%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-47682.135op/s; -43608.767op/s] or [-34.765%; -31.795%]
See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Nov 3, 2024

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241103
git_commit_date 1730486404 1730607506
git_commit_sha d46416d ecf1f2b
See matching parameters
Baseline Candidate
ci_job_date 1730608620 1730608620
ci_job_id 693387602 693387602
ci_pipeline_id 48108546 48108546
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume unsure
[+276.448op/s; +9844.538op/s] or [+0.092%; +3.290%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+1140.378op/s; +11609.695op/s] or [+0.365%; +3.718%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola smola merged commit 3e45e23 into master Nov 4, 2024
99 checks passed
@smola smola deleted the ci/update-gradle-dependencies-20241103 branch November 4, 2024 07:32
@github-actions github-actions bot added this to the 1.42.0 milestone Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@jandro996 jandro996 Awaiting requested review from jandro996 jandro996 is a code owner automatically assigned from DataDog/asm-java

@romainkomorn-exdatadog romainkomorn-exdatadog Awaiting requested review from romainkomorn-exdatadog romainkomorn-exdatadog is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees
No one assigned
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.42.0
Development

Successfully merging this pull request may close these issues.
1 participant
@smola