Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add profiling scenario to onboarding tests #7601

Merged
merged 1 commit into from
Sep 16, 2024
Merged

Add profiling scenario to onboarding tests #7601

merged 1 commit into from
Sep 16, 2024

Conversation

szegedi
Copy link
Contributor

@szegedi szegedi commented Sep 11, 2024 •
edited
Loading

What Does This Do

Adds a profiling scenario to the onboarding tests. You can see it in action as it now ran in the Gitlab checks in this PR!

Motivation

Profiler now supports SSI, so adding a test for it in the test matrix here ensures we quickly notice if it gets broken.

Additional Notes

The test-app-java-buildpack weblog is excluded for now, as it is known to fail due to unrelated reasons in system-tests build.

Contributor Checklist

Jira ticket: PROF-10521

@szegedi szegedi added type: enhancement comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 11, 2024
@pr-commenter
Copy link

pr-commenter bot commented Sep 11, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master szegedi/profiling-onboarding
git_commit_date 1726048502 1726052983
git_commit_sha aae44c7 5b6fac5
release_version 1.40.0-SNAPSHOT~aae44c777e 1.40.0-SNAPSHOT~5b6fac57a5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726055432 1726055432
ci_job_id 635226316 635226316
ci_pipeline_id 44060619 44060619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1073345
Total [baseline] (10.478 s) : 0, 10477571
Agent [candidate] (1.075 s) : 0, 1075378
Total [candidate] (10.407 s) : 0, 10407340
section appsec
Agent [baseline] (1.203 s) : 0, 1203343
Total [baseline] (10.611 s) : 0, 10611096
Agent [candidate] (1.205 s) : 0, 1204557
Total [candidate] (10.629 s) : 0, 10629167
section iast
Agent [baseline] (1.195 s) : 0, 1194708
Total [baseline] (10.915 s) : 0, 10914862
Agent [candidate] (1.196 s) : 0, 1195669
Total [candidate] (10.834 s) : 0, 10834252
section profiling
Agent [baseline] (1.267 s) : 0, 1267331
Total [baseline] (10.576 s) : 0, 10575758
Agent [candidate] (1.275 s) : 0, 1275129
Total [candidate] (10.593 s) : 0, 10592738
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.203 s 129.998 ms (12.1%)
Agent iast 1.195 s 121.363 ms (11.3%)
Agent profiling 1.267 s 193.986 ms (18.1%)
Total tracing 10.478 s -
Total appsec 10.611 s 133.525 ms (1.3%)
Total iast 10.915 s 437.291 ms (4.2%)
Total profiling 10.576 s 98.187 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.205 s 129.179 ms (12.0%)
Agent iast 1.196 s 120.291 ms (11.2%)
Agent profiling 1.275 s 199.751 ms (18.6%)
Total tracing 10.407 s -
Total appsec 10.629 s 221.827 ms (2.1%)
Total iast 10.834 s 426.913 ms (4.1%)
Total profiling 10.593 s 185.398 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.225 ms) : 0, 685225
BytebuddyAgent [candidate] (687.497 ms) : 0, 687497
GlobalTracer [baseline] (313.487 ms) : 0, 313487
GlobalTracer [candidate] (313.552 ms) : 0, 313552
AppSec [baseline] (52.329 ms) : 0, 52329
AppSec [candidate] (52.113 ms) : 0, 52113
Remote Config [baseline] (713.931 µs) : 0, 714
Remote Config [candidate] (713.023 µs) : 0, 713
Telemetry [baseline] (7.717 ms) : 0, 7717
Telemetry [candidate] (7.565 ms) : 0, 7565
section appsec
BytebuddyAgent [baseline] (702.98 ms) : 0, 702980
BytebuddyAgent [candidate] (703.475 ms) : 0, 703475
GlobalTracer [baseline] (305.498 ms) : 0, 305498
GlobalTracer [candidate] (306.202 ms) : 0, 306202
AppSec [baseline] (160.975 ms) : 0, 160975
AppSec [candidate] (162.473 ms) : 0, 162473
IAST [baseline] (20.862 ms) : 0, 20862
IAST [candidate] (19.879 ms) : 0, 19879
Remote Config [baseline] (655.103 µs) : 0, 655
Remote Config [candidate] (650.557 µs) : 0, 651
Telemetry [baseline] (9.025 ms) : 0, 9025
Telemetry [candidate] (8.028 ms) : 0, 8028
section iast
BytebuddyAgent [baseline] (794.569 ms) : 0, 794569
BytebuddyAgent [candidate] (794.77 ms) : 0, 794770
GlobalTracer [baseline] (301.448 ms) : 0, 301448
GlobalTracer [candidate] (302.057 ms) : 0, 302057
AppSec [baseline] (54.028 ms) : 0, 54028
AppSec [candidate] (53.291 ms) : 0, 53291
IAST [baseline] (22.85 ms) : 0, 22850
IAST [candidate] (22.987 ms) : 0, 22987
Remote Config [baseline] (629.947 µs) : 0, 630
Remote Config [candidate] (606.784 µs) : 0, 607
Telemetry [baseline] (7.408 ms) : 0, 7408
Telemetry [candidate] (8.167 ms) : 0, 8167
section profiling
BytebuddyAgent [baseline] (675.536 ms) : 0, 675536
BytebuddyAgent [candidate] (680.972 ms) : 0, 680972
GlobalTracer [baseline] (396.402 ms) : 0, 396402
GlobalTracer [candidate] (397.348 ms) : 0, 397348
AppSec [baseline] (52.515 ms) : 0, 52515
AppSec [candidate] (52.91 ms) : 0, 52910
Remote Config [baseline] (697.238 µs) : 0, 697
Remote Config [candidate] (721.348 µs) : 0, 721
Telemetry [baseline] (7.402 ms) : 0, 7402
Telemetry [candidate] (7.587 ms) : 0, 7587
ProfilingAgent [baseline] (96.373 ms) : 0, 96373
ProfilingAgent [candidate] (96.994 ms) : 0, 96994
Profiling [baseline] (96.397 ms) : 0, 96397
Profiling [candidate] (97.018 ms) : 0, 97018
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069337
Total [baseline] (8.552 s) : 0, 8551577
Agent [candidate] (1.068 s) : 0, 1067935
Total [candidate] (8.555 s) : 0, 8555344
section iast
Agent [baseline] (1.194 s) : 0, 1193531
Total [baseline] (8.991 s) : 0, 8990992
Agent [candidate] (1.191 s) : 0, 1190777
Total [candidate] (9.0 s) : 0, 9000039
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.193 s) : 0, 1192749
Total [baseline] (9.005 s) : 0, 9004608
Agent [candidate] (1.196 s) : 0, 1195880
Total [candidate] (8.978 s) : 0, 8977910
section iast_TELEMETRY_OFF
Agent [baseline] (1.189 s) : 0, 1189354
Total [baseline] (8.988 s) : 0, 8988123
Agent [candidate] (1.191 s) : 0, 1191039
Total [candidate] (9.027 s) : 0, 9026762
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.194 s 124.193 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.193 s 123.412 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.189 s 120.016 ms (11.2%)
Total tracing 8.552 s -
Total iast 8.991 s 439.415 ms (5.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.005 s 453.031 ms (5.3%)
Total iast_TELEMETRY_OFF 8.988 s 436.547 ms (5.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.191 s 122.842 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.196 s 127.945 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.191 s 123.104 ms (11.5%)
Total tracing 8.555 s -
Total iast 9.0 s 444.695 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.978 s 422.566 ms (4.9%)
Total iast_TELEMETRY_OFF 9.027 s 471.418 ms (5.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.708 ms) : 0, 682708
BytebuddyAgent [candidate] (681.427 ms) : 0, 681427
GlobalTracer [baseline] (312.816 ms) : 0, 312816
GlobalTracer [candidate] (312.53 ms) : 0, 312530
AppSec [baseline] (51.741 ms) : 0, 51741
AppSec [candidate] (51.929 ms) : 0, 51929
Remote Config [baseline] (744.483 µs) : 0, 744
Remote Config [candidate] (725.708 µs) : 0, 726
Telemetry [baseline] (7.573 ms) : 0, 7573
Telemetry [candidate] (7.553 ms) : 0, 7553
section iast
BytebuddyAgent [baseline] (794.577 ms) : 0, 794577
BytebuddyAgent [candidate] (791.843 ms) : 0, 791843
GlobalTracer [baseline] (300.105 ms) : 0, 300105
GlobalTracer [candidate] (300.393 ms) : 0, 300393
AppSec [baseline] (51.646 ms) : 0, 51646
AppSec [candidate] (53.971 ms) : 0, 53971
IAST [baseline] (25.42 ms) : 0, 25420
IAST [candidate] (21.195 ms) : 0, 21195
Remote Config [baseline] (620.592 µs) : 0, 621
Remote Config [candidate] (2.152 ms) : 0, 2152
Telemetry [baseline] (7.324 ms) : 0, 7324
Telemetry [candidate] (7.439 ms) : 0, 7439
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (793.161 ms) : 0, 793161
BytebuddyAgent [candidate] (795.152 ms) : 0, 795152
GlobalTracer [baseline] (300.783 ms) : 0, 300783
GlobalTracer [candidate] (301.308 ms) : 0, 301308
AppSec [baseline] (54.267 ms) : 0, 54267
AppSec [candidate] (53.755 ms) : 0, 53755
IAST [baseline] (22.741 ms) : 0, 22741
IAST [candidate] (23.776 ms) : 0, 23776
Remote Config [baseline] (609.878 µs) : 0, 610
Remote Config [candidate] (613.404 µs) : 0, 613
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.403 ms) : 0, 7403
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.126 ms) : 0, 790126
BytebuddyAgent [candidate] (790.955 ms) : 0, 790955
GlobalTracer [baseline] (300.758 ms) : 0, 300758
GlobalTracer [candidate] (301.295 ms) : 0, 301295
AppSec [baseline] (54.192 ms) : 0, 54192
AppSec [candidate] (56.16 ms) : 0, 56160
IAST [baseline] (21.003 ms) : 0, 21003
IAST [candidate] (19.998 ms) : 0, 19998
Remote Config [baseline] (624.344 µs) : 0, 624
Remote Config [candidate] (610.458 µs) : 0, 610
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (8.18 ms) : 0, 8180
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-11T11:18:49 2024-09-11T11:25:40
git_branch master szegedi/profiling-onboarding
git_commit_date 1726048502 1726052983
git_commit_sha aae44c7 5b6fac5
release_version 1.40.0-SNAPSHOT~aae44c777e 1.40.0-SNAPSHOT~5b6fac57a5
start_time 2024-09-11T11:18:35 2024-09-11T11:25:27
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726054290 1726054290
ci_job_id 635226317 635226317
ci_pipeline_id 44060619 44060619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+47.794µs; +101.614µs] or [+3.220%; +6.846%]		 unstable
[-794.246op/s; +320.172op/s] or [-24.820%; +10.005%]		 1.559ms 2962.963op/s 1.484ms 3200.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.336 ms) : 1317, 1355
.   : milestone, 1336,
appsec (1.719 ms) : 1695, 1744
.   : milestone, 1719,
appsec_no_iast (1.709 ms) : 1684, 1734
.   : milestone, 1709,
iast (1.488 ms) : 1464, 1512
.   : milestone, 1488,
profiling (1.484 ms) : 1460, 1508
.   : milestone, 1484,
tracing (1.474 ms) : 1450, 1499
.   : milestone, 1474,
section candidate
no_agent (1.343 ms) : 1324, 1363
.   : milestone, 1343,
appsec (1.712 ms) : 1688, 1737
.   : milestone, 1712,
appsec_no_iast (1.757 ms) : 1732, 1781
.   : milestone, 1757,
iast (1.511 ms) : 1488, 1534
.   : milestone, 1511,
profiling (1.559 ms) : 1533, 1585
.   : milestone, 1559,
tracing (1.475 ms) : 1451, 1500
.   : milestone, 1475,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.336 ms [1.317 ms, 1.355 ms] -
appsec 1.719 ms [1.695 ms, 1.744 ms] 383.057 µs (28.7%)
appsec_no_iast 1.709 ms [1.684 ms, 1.734 ms] 372.871 µs (27.9%)
iast 1.488 ms [1.464 ms, 1.512 ms] 151.84 µs (11.4%)
profiling 1.484 ms [1.46 ms, 1.508 ms] 148.005 µs (11.1%)
tracing 1.474 ms [1.45 ms, 1.499 ms] 137.879 µs (10.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.343 ms [1.324 ms, 1.363 ms] -
appsec 1.712 ms [1.688 ms, 1.737 ms] 369.379 µs (27.5%)
appsec_no_iast 1.757 ms [1.732 ms, 1.781 ms] 413.524 µs (30.8%)
iast 1.511 ms [1.488 ms, 1.534 ms] 167.726 µs (12.5%)
profiling 1.559 ms [1.533 ms, 1.585 ms] 215.907 µs (16.1%)
tracing 1.475 ms [1.451 ms, 1.5 ms] 132.342 µs (9.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.485 µs) : 353, 392
.   : milestone, 372,
iast (481.654 µs) : 460, 504
.   : milestone, 482,
iast_FULL (557.004 µs) : 536, 578
.   : milestone, 557,
iast_GLOBAL (519.253 µs) : 497, 541
.   : milestone, 519,
iast_HARDCODED_SECRET_DISABLED (496.442 µs) : 475, 518
.   : milestone, 496,
iast_INACTIVE (446.409 µs) : 426, 467
.   : milestone, 446,
iast_TELEMETRY_OFF (481.298 µs) : 458, 504
.   : milestone, 481,
tracing (444.903 µs) : 424, 466
.   : milestone, 445,
section candidate
no_agent (376.976 µs) : 357, 397
.   : milestone, 377,
iast (486.462 µs) : 465, 508
.   : milestone, 486,
iast_FULL (560.541 µs) : 539, 582
.   : milestone, 561,
iast_GLOBAL (522.269 µs) : 499, 546
.   : milestone, 522,
iast_HARDCODED_SECRET_DISABLED (486.809 µs) : 465, 509
.   : milestone, 487,
iast_INACTIVE (448.539 µs) : 428, 469
.   : milestone, 449,
iast_TELEMETRY_OFF (472.483 µs) : 450, 495
.   : milestone, 472,
tracing (443.416 µs) : 423, 464
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.485 µs [353.088 µs, 391.882 µs] -
iast 481.654 µs [459.728 µs, 503.58 µs] 109.169 µs (29.3%)
iast_FULL 557.004 µs [535.723 µs, 578.286 µs] 184.519 µs (49.5%)
iast_GLOBAL 519.253 µs [497.039 µs, 541.466 µs] 146.767 µs (39.4%)
iast_HARDCODED_SECRET_DISABLED 496.442 µs [474.91 µs, 517.974 µs] 123.957 µs (33.3%)
iast_INACTIVE 446.409 µs [425.682 µs, 467.137 µs] 73.924 µs (19.8%)
iast_TELEMETRY_OFF 481.298 µs [458.431 µs, 504.165 µs] 108.813 µs (29.2%)
tracing 444.903 µs [423.892 µs, 465.915 µs] 72.418 µs (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.976 µs [357.304 µs, 396.647 µs] -
iast 486.462 µs [465.228 µs, 507.697 µs] 109.487 µs (29.0%)
iast_FULL 560.541 µs [539.318 µs, 581.765 µs] 183.566 µs (48.7%)
iast_GLOBAL 522.269 µs [499.004 µs, 545.534 µs] 145.293 µs (38.5%)
iast_HARDCODED_SECRET_DISABLED 486.809 µs [464.524 µs, 509.094 µs] 109.833 µs (29.1%)
iast_INACTIVE 448.539 µs [427.683 µs, 469.394 µs] 71.563 µs (19.0%)
iast_TELEMETRY_OFF 472.483 µs [450.046 µs, 494.92 µs] 95.507 µs (25.3%)
tracing 443.416 µs [423.318 µs, 463.514 µs] 66.44 µs (17.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master szegedi/profiling-onboarding
git_commit_date 1726048502 1726052983
git_commit_sha aae44c7 5b6fac5
release_version 1.40.0-SNAPSHOT~aae44c777e 1.40.0-SNAPSHOT~5b6fac57a5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1726054964 1726054964
ci_job_id 635226318 635226318
ci_pipeline_id 44060619 44060619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.458 ms) : 1447, 1469
.   : milestone, 1458,
appsec (2.276 ms) : 2236, 2317
.   : milestone, 2276,
iast (2.037 ms) : 1987, 2086
.   : milestone, 2037,
iast_GLOBAL (2.09 ms) : 2039, 2140
.   : milestone, 2090,
profiling (1.913 ms) : 1872, 1955
.   : milestone, 1913,
tracing (1.885 ms) : 1847, 1923
.   : milestone, 1885,
section candidate
no_agent (1.459 ms) : 1447, 1470
.   : milestone, 1459,
appsec (2.284 ms) : 2243, 2324
.   : milestone, 2284,
iast (2.031 ms) : 1983, 2079
.   : milestone, 2031,
iast_GLOBAL (2.084 ms) : 2034, 2134
.   : milestone, 2084,
profiling (1.913 ms) : 1874, 1952
.   : milestone, 1913,
tracing (1.899 ms) : 1860, 1937
.   : milestone, 1899,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.458 ms [1.447 ms, 1.469 ms] -
appsec 2.276 ms [2.236 ms, 2.317 ms] 818.503 µs (56.1%)
iast 2.037 ms [1.987 ms, 2.086 ms] 578.638 µs (39.7%)
iast_GLOBAL 2.09 ms [2.039 ms, 2.14 ms] 631.706 µs (43.3%)
profiling 1.913 ms [1.872 ms, 1.955 ms] 455.178 µs (31.2%)
tracing 1.885 ms [1.847 ms, 1.923 ms] 427.158 µs (29.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.447 ms, 1.47 ms] -
appsec 2.284 ms [2.243 ms, 2.324 ms] 825.036 µs (56.6%)
iast 2.031 ms [1.983 ms, 2.079 ms] 572.149 µs (39.2%)
iast_GLOBAL 2.084 ms [2.034 ms, 2.134 ms] 625.062 µs (42.9%)
profiling 1.913 ms [1.874 ms, 1.952 ms] 454.462 µs (31.2%)
tracing 1.899 ms [1.86 ms, 1.937 ms] 439.86 µs (30.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~5b6fac57a5, baseline=1.40.0-SNAPSHOT~aae44c777e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.732 s) : 15732000, 15732000
.   : milestone, 15732000,
appsec (15.272 s) : 15272000, 15272000
.   : milestone, 15272000,
iast (19.006 s) : 19006000, 19006000
.   : milestone, 19006000,
iast_GLOBAL (18.064 s) : 18064000, 18064000
.   : milestone, 18064000,
profiling (15.282 s) : 15282000, 15282000
.   : milestone, 15282000,
tracing (15.235 s) : 15235000, 15235000
.   : milestone, 15235000,
section candidate
no_agent (15.07 s) : 15070000, 15070000
.   : milestone, 15070000,
appsec (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
iast (18.699 s) : 18699000, 18699000
.   : milestone, 18699000,
iast_GLOBAL (18.102 s) : 18102000, 18102000
.   : milestone, 18102000,
profiling (15.43 s) : 15430000, 15430000
.   : milestone, 15430000,
tracing (15.32 s) : 15320000, 15320000
.   : milestone, 15320000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.732 s [15.732 s, 15.732 s] -
appsec 15.272 s [15.272 s, 15.272 s] -460.0 ms (-2.9%)
iast 19.006 s [19.006 s, 19.006 s] 3.274 s (20.8%)
iast_GLOBAL 18.064 s [18.064 s, 18.064 s] 2.332 s (14.8%)
profiling 15.282 s [15.282 s, 15.282 s] -450.0 ms (-2.9%)
tracing 15.235 s [15.235 s, 15.235 s] -497.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.07 s [15.07 s, 15.07 s] -
appsec 15.326 s [15.326 s, 15.326 s] 256.0 ms (1.7%)
iast 18.699 s [18.699 s, 18.699 s] 3.629 s (24.1%)
iast_GLOBAL 18.102 s [18.102 s, 18.102 s] 3.032 s (20.1%)
profiling 15.43 s [15.43 s, 15.43 s] 360.0 ms (2.4%)
tracing 15.32 s [15.32 s, 15.32 s] 250.0 ms (1.7%)

@szegedi szegedi marked this pull request as ready for review September 13, 2024 11:02
@szegedi szegedi requested a review from a team as a code owner September 13, 2024 11:02
manuel-alvarez-alvarez
manuel-alvarez-alvarez approved these changes Sep 16, 2024
View reviewed changes
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@szegedi szegedi merged commit bb8b0d2 into master Sep 16, 2024
104 checks passed
@szegedi szegedi deleted the szegedi/profiling-onboarding branch September 16, 2024 12:47
@github-actions github-actions bot added this to the 1.40.0 milestone Sep 16, 2024
@szegedi szegedi mentioned this pull request Oct 25, 2024
Open
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

@jbachorik jbachorik Awaiting requested review from jbachorik

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement
Projects
None yet
Milestone
1.40.0
Development

Successfully merging this pull request may close these issues.
2 participants
@szegedi @manuel-alvarez-alvarez