Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the buildpack weblog to the profiling onboarding scenario #7835

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Add the buildpack weblog to the profiling onboarding scenario #7835

wants to merge 1 commit into from

Conversation

szegedi
Copy link
Contributor

@szegedi szegedi commented Oct 25, 2024

What Does This Do

Adds test-app-java-buildpack to the SIMPLE_AUTO_INJECTION_PROFILING onboarding scenario.

Motivation

test-app-java-buildpack was originally excluded in #7601 because it was failing for reasons to do with the build environment. This has since been fixed, so we can now ensure symmetry in all weblogs being tested with both a tracing and a profiling scenario.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-10521]

@szegedi szegedi added type: enhancement comp: testing Testing tag: no release notes Changes to exclude from release notes labels Oct 25, 2024
@pr-commenter
Copy link

pr-commenter bot commented Oct 25, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master szegedi/add-buildpack-to-profiling-scenario
git_commit_date 1729797010 1729844742
git_commit_sha ec5eedc 5a06b6f
release_version 1.42.0-SNAPSHOT~ec5eedcf29 1.42.0-SNAPSHOT~5a06b6fa0e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729847212 1729847212
ci_job_id 684117530 684117530
ci_pipeline_id 47422244 47422244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1076861
Total [baseline] (8.557 s) : 0, 8557246
Agent [candidate] (1.077 s) : 0, 1077449
Total [candidate] (8.57 s) : 0, 8570004
section iast
Agent [baseline] (1.199 s) : 0, 1199113
Total [baseline] (9.094 s) : 0, 9094344
Agent [candidate] (1.201 s) : 0, 1200710
Total [candidate] (9.135 s) : 0, 9134712
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.201 s) : 0, 1201280
Total [baseline] (9.101 s) : 0, 9101343
Agent [candidate] (1.198 s) : 0, 1197643
Total [candidate] (9.06 s) : 0, 9060375
section iast_TELEMETRY_OFF
Agent [baseline] (1.202 s) : 0, 1202401
Total [baseline] (9.079 s) : 0, 9079129
Agent [candidate] (1.199 s) : 0, 1198764
Total [candidate] (9.07 s) : 0, 9070134
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.199 s 122.252 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.201 s 124.419 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.202 s 125.54 ms (11.7%)
Total tracing 8.557 s -
Total iast 9.094 s 537.098 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.101 s 544.097 ms (6.4%)
Total iast_TELEMETRY_OFF 9.079 s 521.882 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.201 s 123.261 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.198 s 120.194 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.199 s 121.315 ms (11.3%)
Total tracing 8.57 s -
Total iast 9.135 s 564.708 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.06 s 490.371 ms (5.7%)
Total iast_TELEMETRY_OFF 9.07 s 500.13 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.04 ms) : 0, 686040
BytebuddyAgent [candidate] (685.072 ms) : 0, 685072
GlobalTracer [baseline] (313.317 ms) : 0, 313317
GlobalTracer [candidate] (312.991 ms) : 0, 312991
AppSec [baseline] (53.31 ms) : 0, 53310
AppSec [candidate] (53.787 ms) : 0, 53787
Remote Config [baseline] (711.868 µs) : 0, 712
Remote Config [candidate] (650.738 µs) : 0, 651
Telemetry [baseline] (9.844 ms) : 0, 9844
Telemetry [candidate] (11.296 ms) : 0, 11296
section iast
BytebuddyAgent [baseline] (799.144 ms) : 0, 799144
BytebuddyAgent [candidate] (800.393 ms) : 0, 800393
GlobalTracer [baseline] (301.199 ms) : 0, 301199
GlobalTracer [candidate] (301.451 ms) : 0, 301451
AppSec [baseline] (56.985 ms) : 0, 56985
AppSec [candidate] (56.08 ms) : 0, 56080
Remote Config [baseline] (583.774 µs) : 0, 584
Remote Config [candidate] (595.176 µs) : 0, 595
Telemetry [baseline] (7.37 ms) : 0, 7370
Telemetry [candidate] (7.298 ms) : 0, 7298
IAST [baseline] (20.215 ms) : 0, 20215
IAST [candidate] (21.179 ms) : 0, 21179
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.336 ms) : 0, 800336
BytebuddyAgent [candidate] (797.964 ms) : 0, 797964
GlobalTracer [baseline] (302.014 ms) : 0, 302014
GlobalTracer [candidate] (301.023 ms) : 0, 301023
AppSec [baseline] (55.772 ms) : 0, 55772
AppSec [candidate] (56.07 ms) : 0, 56070
Remote Config [baseline] (575.281 µs) : 0, 575
Remote Config [candidate] (588.156 µs) : 0, 588
Telemetry [baseline] (7.317 ms) : 0, 7317
Telemetry [candidate] (7.393 ms) : 0, 7393
IAST [baseline] (21.629 ms) : 0, 21629
IAST [candidate] (20.983 ms) : 0, 20983
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (800.992 ms) : 0, 800992
BytebuddyAgent [candidate] (797.667 ms) : 0, 797667
GlobalTracer [baseline] (302.507 ms) : 0, 302507
GlobalTracer [candidate] (302.079 ms) : 0, 302079
AppSec [baseline] (57.418 ms) : 0, 57418
AppSec [candidate] (57.275 ms) : 0, 57275
Remote Config [baseline] (591.053 µs) : 0, 591
Remote Config [candidate] (603.306 µs) : 0, 603
Telemetry [baseline] (7.237 ms) : 0, 7237
Telemetry [candidate] (7.291 ms) : 0, 7291
IAST [baseline] (19.939 ms) : 0, 19939
IAST [candidate] (20.168 ms) : 0, 20168
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1082489
Total [baseline] (10.472 s) : 0, 10472132
Agent [candidate] (1.076 s) : 0, 1076402
Total [candidate] (10.378 s) : 0, 10378439
section appsec
Agent [baseline] (1.216 s) : 0, 1216043
Total [baseline] (10.668 s) : 0, 10668313
Agent [candidate] (1.215 s) : 0, 1214747
Total [candidate] (10.639 s) : 0, 10638984
section iast
Agent [baseline] (1.203 s) : 0, 1203461
Total [baseline] (10.836 s) : 0, 10836343
Agent [candidate] (1.206 s) : 0, 1205971
Total [candidate] (10.85 s) : 0, 10850255
section profiling
Agent [baseline] (1.285 s) : 0, 1285125
Total [baseline] (10.722 s) : 0, 10721571
Agent [candidate] (1.27 s) : 0, 1270497
Total [candidate] (10.623 s) : 0, 10622884
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.216 s 133.554 ms (12.3%)
Agent iast 1.203 s 120.972 ms (11.2%)
Agent profiling 1.285 s 202.636 ms (18.7%)
Total tracing 10.472 s -
Total appsec 10.668 s 196.181 ms (1.9%)
Total iast 10.836 s 364.211 ms (3.5%)
Total profiling 10.722 s 249.439 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.215 s 138.346 ms (12.9%)
Agent iast 1.206 s 129.57 ms (12.0%)
Agent profiling 1.27 s 194.096 ms (18.0%)
Total tracing 10.378 s -
Total appsec 10.639 s 260.544 ms (2.5%)
Total iast 10.85 s 471.815 ms (4.5%)
Total profiling 10.623 s 244.445 ms (2.4%) 
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.766 ms) : 0, 687766
BytebuddyAgent [candidate] (685.685 ms) : 0, 685685
GlobalTracer [baseline] (316.684 ms) : 0, 316684
GlobalTracer [candidate] (312.689 ms) : 0, 312689
AppSec [baseline] (54.417 ms) : 0, 54417
AppSec [candidate] (53.824 ms) : 0, 53824
Remote Config [baseline] (666.818 µs) : 0, 667
Remote Config [candidate] (667.482 µs) : 0, 667
Telemetry [baseline] (9.276 ms) : 0, 9276
Telemetry [candidate] (9.91 ms) : 0, 9910
section appsec
BytebuddyAgent [baseline] (705.433 ms) : 0, 705433
BytebuddyAgent [candidate] (704.793 ms) : 0, 704793
GlobalTracer [baseline] (311.813 ms) : 0, 311813
GlobalTracer [candidate] (311.143 ms) : 0, 311143
AppSec [baseline] (166.769 ms) : 0, 166769
AppSec [candidate] (165.504 ms) : 0, 165504
Remote Config [baseline] (632.857 µs) : 0, 633
Remote Config [candidate] (639.49 µs) : 0, 639
Telemetry [baseline] (8.111 ms) : 0, 8111
Telemetry [candidate] (8.822 ms) : 0, 8822
IAST [baseline] (19.243 ms) : 0, 19243
IAST [candidate] (20.327 ms) : 0, 20327
section iast
BytebuddyAgent [baseline] (802.164 ms) : 0, 802164
BytebuddyAgent [candidate] (803.702 ms) : 0, 803702
GlobalTracer [baseline] (301.964 ms) : 0, 301964
GlobalTracer [candidate] (303.074 ms) : 0, 303074
AppSec [baseline] (56.577 ms) : 0, 56577
AppSec [candidate] (57.408 ms) : 0, 57408
Remote Config [baseline] (587.764 µs) : 0, 588
Remote Config [candidate] (594.109 µs) : 0, 594
Telemetry [baseline] (8.172 ms) : 0, 8172
Telemetry [candidate] (7.324 ms) : 0, 7324
IAST [baseline] (20.322 ms) : 0, 20322
IAST [candidate] (20.162 ms) : 0, 20162
section profiling
BytebuddyAgent [baseline] (687.215 ms) : 0, 687215
BytebuddyAgent [candidate] (678.088 ms) : 0, 678088
GlobalTracer [baseline] (399.111 ms) : 0, 399111
GlobalTracer [candidate] (395.849 ms) : 0, 395849
AppSec [baseline] (54.821 ms) : 0, 54821
AppSec [candidate] (54.184 ms) : 0, 54184
Remote Config [baseline] (657.5 µs) : 0, 657
Remote Config [candidate] (641.673 µs) : 0, 642
Telemetry [baseline] (12.826 ms) : 0, 12826
Telemetry [candidate] (11.864 ms) : 0, 11864
ProfilingAgent [baseline] (91.436 ms) : 0, 91436
ProfilingAgent [candidate] (91.226 ms) : 0, 91226
Profiling [baseline] (91.46 ms) : 0, 91460
Profiling [candidate] (91.249 ms) : 0, 91249
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-25T08:37:21 2024-10-25T08:44:12
git_branch master szegedi/add-buildpack-to-profiling-scenario
git_commit_date 1729797010 1729844742
git_commit_sha ec5eedc 5a06b6f
release_version 1.42.0-SNAPSHOT~ec5eedcf29 1.42.0-SNAPSHOT~5a06b6fa0e
start_time 2024-10-25T08:37:08 2024-10-25T08:43:59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729846200 1729846200
ci_job_id 684117532 684117532
ci_pipeline_id 47422244 47422244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29
    dateFormat X
    axisFormat %s
section baseline
no_agent (370.757 µs) : 349, 392
.   : milestone, 371,
iast (482.755 µs) : 461, 504
.   : milestone, 483,
iast_FULL (554.295 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (520.354 µs) : 498, 543
.   : milestone, 520,
iast_HARDCODED_SECRET_DISABLED (487.629 µs) : 467, 509
.   : milestone, 488,
iast_INACTIVE (448.595 µs) : 428, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (469.439 µs) : 448, 490
.   : milestone, 469,
tracing (442.599 µs) : 422, 463
.   : milestone, 443,
section candidate
no_agent (366.117 µs) : 345, 387
.   : milestone, 366,
iast (486.24 µs) : 465, 508
.   : milestone, 486,
iast_FULL (559.118 µs) : 538, 580
.   : milestone, 559,
iast_GLOBAL (514.339 µs) : 493, 536
.   : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (480.151 µs) : 459, 501
.   : milestone, 480,
iast_INACTIVE (447.19 µs) : 426, 468
.   : milestone, 447,
iast_TELEMETRY_OFF (471.182 µs) : 450, 492
.   : milestone, 471,
tracing (442.509 µs) : 422, 463
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.757 µs [349.294 µs, 392.22 µs] -
iast 482.755 µs [461.47 µs, 504.041 µs] 111.998 µs (30.2%)
iast_FULL 554.295 µs [533.13 µs, 575.46 µs] 183.538 µs (49.5%)
iast_GLOBAL 520.354 µs [497.704 µs, 543.004 µs] 149.597 µs (40.3%)
iast_HARDCODED_SECRET_DISABLED 487.629 µs [466.533 µs, 508.725 µs] 116.872 µs (31.5%)
iast_INACTIVE 448.595 µs [427.661 µs, 469.529 µs] 77.838 µs (21.0%)
iast_TELEMETRY_OFF 469.439 µs [448.469 µs, 490.409 µs] 98.682 µs (26.6%)
tracing 442.599 µs [422.26 µs, 462.937 µs] 71.842 µs (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.117 µs [345.295 µs, 386.94 µs] -
iast 486.24 µs [464.551 µs, 507.93 µs] 120.123 µs (32.8%)
iast_FULL 559.118 µs [537.787 µs, 580.449 µs] 193.001 µs (52.7%)
iast_GLOBAL 514.339 µs [492.714 µs, 535.963 µs] 148.221 µs (40.5%)
iast_HARDCODED_SECRET_DISABLED 480.151 µs [459.15 µs, 501.152 µs] 114.034 µs (31.1%)
iast_INACTIVE 447.19 µs [426.348 µs, 468.032 µs] 81.073 µs (22.1%)
iast_TELEMETRY_OFF 471.182 µs [449.988 µs, 492.376 µs] 105.065 µs (28.7%)
tracing 442.509 µs [421.835 µs, 463.183 µs] 76.392 µs (20.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.324 ms) : 1305, 1343
.   : milestone, 1324,
appsec (1.73 ms) : 1706, 1754
.   : milestone, 1730,
appsec_no_iast (1.727 ms) : 1702, 1752
.   : milestone, 1727,
iast (1.505 ms) : 1482, 1528
.   : milestone, 1505,
profiling (1.469 ms) : 1446, 1492
.   : milestone, 1469,
tracing (1.459 ms) : 1435, 1483
.   : milestone, 1459,
section candidate
no_agent (1.333 ms) : 1314, 1352
.   : milestone, 1333,
appsec (1.719 ms) : 1694, 1743
.   : milestone, 1719,
appsec_no_iast (1.726 ms) : 1702, 1749
.   : milestone, 1726,
iast (1.49 ms) : 1468, 1513
.   : milestone, 1490,
profiling (1.481 ms) : 1457, 1505
.   : milestone, 1481,
tracing (1.48 ms) : 1456, 1504
.   : milestone, 1480,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.324 ms [1.305 ms, 1.343 ms] -
appsec 1.73 ms [1.706 ms, 1.754 ms] 405.948 µs (30.7%)
appsec_no_iast 1.727 ms [1.702 ms, 1.752 ms] 402.605 µs (30.4%)
iast 1.505 ms [1.482 ms, 1.528 ms] 181.153 µs (13.7%)
profiling 1.469 ms [1.446 ms, 1.492 ms] 144.5 µs (10.9%)
tracing 1.459 ms [1.435 ms, 1.483 ms] 135.042 µs (10.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.333 ms [1.314 ms, 1.352 ms] -
appsec 1.719 ms [1.694 ms, 1.743 ms] 386.036 µs (29.0%)
appsec_no_iast 1.726 ms [1.702 ms, 1.749 ms] 392.781 µs (29.5%)
iast 1.49 ms [1.468 ms, 1.513 ms] 157.714 µs (11.8%)
profiling 1.481 ms [1.457 ms, 1.505 ms] 148.127 µs (11.1%)
tracing 1.48 ms [1.456 ms, 1.504 ms] 146.875 µs (11.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master szegedi/add-buildpack-to-profiling-scenario
git_commit_date 1729797010 1729844742
git_commit_sha ec5eedc 5a06b6f
release_version 1.42.0-SNAPSHOT~ec5eedcf29 1.42.0-SNAPSHOT~5a06b6fa0e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1729846725 1729846725
ci_job_id 684117537 684117537
ci_pipeline_id 47422244 47422244
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1475
.   : milestone, 1464,
appsec (2.33 ms) : 2289, 2371
.   : milestone, 2330,
iast (2.066 ms) : 2014, 2117
.   : milestone, 2066,
iast_GLOBAL (2.113 ms) : 2061, 2166
.   : milestone, 2113,
profiling (1.928 ms) : 1887, 1969
.   : milestone, 1928,
tracing (1.913 ms) : 1873, 1953
.   : milestone, 1913,
section candidate
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.307 ms) : 2266, 2347
.   : milestone, 2307,
iast (2.063 ms) : 2011, 2115
.   : milestone, 2063,
iast_GLOBAL (2.107 ms) : 2055, 2159
.   : milestone, 2107,
profiling (1.923 ms) : 1882, 1965
.   : milestone, 1923,
tracing (1.902 ms) : 1863, 1942
.   : milestone, 1902,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.475 ms] -
appsec 2.33 ms [2.289 ms, 2.371 ms] 866.016 µs (59.2%)
iast 2.066 ms [2.014 ms, 2.117 ms] 601.581 µs (41.1%)
iast_GLOBAL 2.113 ms [2.061 ms, 2.166 ms] 649.201 µs (44.3%)
profiling 1.928 ms [1.887 ms, 1.969 ms] 463.964 µs (31.7%)
tracing 1.913 ms [1.873 ms, 1.953 ms] 449.199 µs (30.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.307 ms [2.266 ms, 2.347 ms] 844.837 µs (57.8%)
iast 2.063 ms [2.011 ms, 2.115 ms] 601.039 µs (41.1%)
iast_GLOBAL 2.107 ms [2.055 ms, 2.159 ms] 645.421 µs (44.2%)
profiling 1.923 ms [1.882 ms, 1.965 ms] 461.724 µs (31.6%)
tracing 1.902 ms [1.863 ms, 1.942 ms] 440.75 µs (30.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~5a06b6fa0e, baseline=1.42.0-SNAPSHOT~ec5eedcf29
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.859 s) : 15859000, 15859000
.   : milestone, 15859000,
appsec (15.308 s) : 15308000, 15308000
.   : milestone, 15308000,
iast (19.176 s) : 19176000, 19176000
.   : milestone, 19176000,
iast_GLOBAL (17.921 s) : 17921000, 17921000
.   : milestone, 17921000,
profiling (15.593 s) : 15593000, 15593000
.   : milestone, 15593000,
tracing (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
section candidate
no_agent (15.348 s) : 15348000, 15348000
.   : milestone, 15348000,
appsec (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
iast (18.998 s) : 18998000, 18998000
.   : milestone, 18998000,
iast_GLOBAL (18.086 s) : 18086000, 18086000
.   : milestone, 18086000,
profiling (15.638 s) : 15638000, 15638000
.   : milestone, 15638000,
tracing (15.429 s) : 15429000, 15429000
.   : milestone, 15429000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.859 s [15.859 s, 15.859 s] -
appsec 15.308 s [15.308 s, 15.308 s] -551.0 ms (-3.5%)
iast 19.176 s [19.176 s, 19.176 s] 3.317 s (20.9%)
iast_GLOBAL 17.921 s [17.921 s, 17.921 s] 2.062 s (13.0%)
profiling 15.593 s [15.593 s, 15.593 s] -266.0 ms (-1.7%)
tracing 15.142 s [15.142 s, 15.142 s] -717.0 ms (-4.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.348 s [15.348 s, 15.348 s] -
appsec 15.23 s [15.23 s, 15.23 s] -118.0 ms (-0.8%)
iast 18.998 s [18.998 s, 18.998 s] 3.65 s (23.8%)
iast_GLOBAL 18.086 s [18.086 s, 18.086 s] 2.738 s (17.8%)
profiling 15.638 s [15.638 s, 15.638 s] 290.0 ms (1.9%)
tracing 15.429 s [15.429 s, 15.429 s] 81.0 ms (0.5%)

@szegedi szegedi marked this pull request as ready for review October 28, 2024 09:53
@szegedi szegedi requested a review from a team as a code owner October 28, 2024 09:53
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 1, 2025

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

@github-actions github-actions bot added the tag: stale Stale pull requests label Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes tag: stale Stale pull requests type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@szegedi @manuel-alvarez-alvarez