Skip to content

Update CI reports to prod #7922

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 12, 2024
Merged

Update CI reports to prod #7922

merged 1 commit into from
Nov 12, 2024

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Nov 8, 2024

What Does This Do

This PR sends tests and static analysis result reports to Datadog production environment.

Motivation

This was previously set up for staging, but all the repositories moved to production.
In order to have a complete view of the different projects and CI, this uploads the results to the production environment.

Additional Notes

We will still send data to the staging environment to benefit from staging features.

Contributor Checklist

Jira ticket: APMSP-1519

@PerfectSlayer PerfectSlayer added type: enhancement tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 8, 2024
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner November 8, 2024 13:31
@PerfectSlayer PerfectSlayer requested a review from smola November 8, 2024 13:31
@pr-commenter
Copy link

pr-commenter bot commented Nov 8, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1731353240 1731403363
git_commit_sha f19a626 b100bc8
release_version 1.43.0-SNAPSHOT~f19a626f66 1.43.0-SNAPSHOT~b100bc8a16
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731406553 1731406553
ci_job_id 703304644 703304644
ci_pipeline_id 48776743 48776743
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.588 s) : 0, 1587809
Total [baseline] (11.901 s) : 0, 11901360
Agent [candidate] (1.586 s) : 0, 1586223
Total [candidate] (11.9 s) : 0, 11900364
section iast
Agent [baseline] (1.754 s) : 0, 1753565
Total [baseline] (12.768 s) : 0, 12767688
Agent [candidate] (1.755 s) : 0, 1755123
Total [candidate] (12.787 s) : 0, 12786651
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.757 s) : 0, 1756831
Total [baseline] (12.749 s) : 0, 12748809
Agent [candidate] (1.756 s) : 0, 1756352
Total [candidate] (12.725 s) : 0, 12725032
section iast_TELEMETRY_OFF
Agent [baseline] (1.755 s) : 0, 1755113
Total [baseline] (12.801 s) : 0, 12800726
Agent [candidate] (1.756 s) : 0, 1756289
Total [candidate] (12.807 s) : 0, 12806763
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.588 s -
Agent iast 1.754 s 165.757 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.757 s 169.022 ms (10.6%)
Agent iast_TELEMETRY_OFF 1.755 s 167.304 ms (10.5%)
Total tracing 11.901 s -
Total iast 12.768 s 866.327 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 12.749 s 847.449 ms (7.1%)
Total iast_TELEMETRY_OFF 12.801 s 899.366 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.586 s -
Agent iast 1.755 s 168.901 ms (10.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.756 s 170.129 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.756 s 170.066 ms (10.7%)
Total tracing 11.9 s -
Total iast 12.787 s 886.288 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 12.725 s 824.669 ms (6.9%)
Total iast_TELEMETRY_OFF 12.807 s 906.4 ms (7.6%)
gantt
    title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.014 s) : 0, 1014371
BytebuddyAgent [candidate] (1.013 s) : 0, 1012606
GlobalTracer [baseline] (466.298 ms) : 0, 466298
GlobalTracer [candidate] (465.853 ms) : 0, 465853
AppSec [baseline] (75.427 ms) : 0, 75427
AppSec [candidate] (75.984 ms) : 0, 75984
Remote Config [baseline] (843.737 µs) : 0, 844
Remote Config [candidate] (839.214 µs) : 0, 839
Telemetry [baseline] (10.617 ms) : 0, 10617
Telemetry [candidate] (10.669 ms) : 0, 10669
section iast
BytebuddyAgent [baseline] (1.174 s) : 0, 1174475
BytebuddyAgent [candidate] (1.175 s) : 0, 1175243
GlobalTracer [baseline] (444.327 ms) : 0, 444327
GlobalTracer [candidate] (444.881 ms) : 0, 444881
AppSec [baseline] (77.739 ms) : 0, 77739
AppSec [candidate] (77.092 ms) : 0, 77092
IAST [baseline] (26.602 ms) : 0, 26602
IAST [candidate] (27.385 ms) : 0, 27385
Remote Config [baseline] (746.853 µs) : 0, 747
Remote Config [candidate] (743.126 µs) : 0, 743
Telemetry [baseline] (9.495 ms) : 0, 9495
Telemetry [candidate] (9.454 ms) : 0, 9454
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.177 s) : 0, 1176651
BytebuddyAgent [candidate] (1.176 s) : 0, 1176020
GlobalTracer [baseline] (444.628 ms) : 0, 444628
GlobalTracer [candidate] (445.016 ms) : 0, 445016
AppSec [baseline] (75.776 ms) : 0, 75776
AppSec [candidate] (78.405 ms) : 0, 78405
IAST [baseline] (29.249 ms) : 0, 29249
IAST [candidate] (26.313 ms) : 0, 26313
Remote Config [baseline] (740.92 µs) : 0, 741
Remote Config [candidate] (723.716 µs) : 0, 724
Telemetry [baseline] (9.572 ms) : 0, 9572
Telemetry [candidate] (9.458 ms) : 0, 9458
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.174 s) : 0, 1173506
BytebuddyAgent [candidate] (1.175 s) : 0, 1175206
GlobalTracer [baseline] (445.419 ms) : 0, 445419
GlobalTracer [candidate] (445.671 ms) : 0, 445671
AppSec [baseline] (77.523 ms) : 0, 77523
AppSec [candidate] (78.081 ms) : 0, 78081
IAST [baseline] (28.303 ms) : 0, 28303
IAST [candidate] (26.665 ms) : 0, 26665
Remote Config [baseline] (742.504 µs) : 0, 743
Remote Config [candidate] (757.792 µs) : 0, 758
Telemetry [baseline] (9.386 ms) : 0, 9386
Telemetry [candidate] (9.573 ms) : 0, 9573
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.59 s) : 0, 1590006
Total [baseline] (14.391 s) : 0, 14390523
Agent [candidate] (1.587 s) : 0, 1586606
Total [candidate] (14.324 s) : 0, 14323731
section appsec
Agent [baseline] (1.788 s) : 0, 1788233
Total [baseline] (14.597 s) : 0, 14597251
Agent [candidate] (1.791 s) : 0, 1791073
Total [candidate] (14.694 s) : 0, 14693984
section iast
Agent [baseline] (1.757 s) : 0, 1757191
Total [baseline] (14.857 s) : 0, 14857185
Agent [candidate] (1.757 s) : 0, 1757239
Total [candidate] (14.954 s) : 0, 14954151
section profiling
Agent [baseline] (1.915 s) : 0, 1915157
Total [baseline] (14.744 s) : 0, 14744312
Agent [candidate] (1.917 s) : 0, 1917198
Total [candidate] (14.687 s) : 0, 14686852
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.59 s -
Agent appsec 1.788 s 198.227 ms (12.5%)
Agent iast 1.757 s 167.185 ms (10.5%)
Agent profiling 1.915 s 325.151 ms (20.4%)
Total tracing 14.391 s -
Total appsec 14.597 s 206.728 ms (1.4%)
Total iast 14.857 s 466.662 ms (3.2%)
Total profiling 14.744 s 353.789 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.587 s -
Agent appsec 1.791 s 204.468 ms (12.9%)
Agent iast 1.757 s 170.633 ms (10.8%)
Agent profiling 1.917 s 330.592 ms (20.8%)
Total tracing 14.324 s -
Total appsec 14.694 s 370.253 ms (2.6%)
Total iast 14.954 s 630.419 ms (4.4%)
Total profiling 14.687 s 363.121 ms (2.5%)
gantt
    title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.015 s) : 0, 1014980
BytebuddyAgent [candidate] (1.013 s) : 0, 1012634
GlobalTracer [baseline] (466.607 ms) : 0, 466607
GlobalTracer [candidate] (465.695 ms) : 0, 465695
AppSec [baseline] (75.928 ms) : 0, 75928
AppSec [candidate] (75.81 ms) : 0, 75810
Remote Config [baseline] (821.985 µs) : 0, 822
Remote Config [candidate] (828.512 µs) : 0, 829
Telemetry [baseline] (11.395 ms) : 0, 11395
Telemetry [candidate] (11.369 ms) : 0, 11369
section appsec
BytebuddyAgent [baseline] (1.039 s) : 0, 1038526
BytebuddyAgent [candidate] (1.039 s) : 0, 1039485
GlobalTracer [baseline] (462.551 ms) : 0, 462551
GlobalTracer [candidate] (463.478 ms) : 0, 463478
AppSec [baseline] (243.355 ms) : 0, 243355
AppSec [candidate] (243.953 ms) : 0, 243953
IAST [baseline] (25.168 ms) : 0, 25168
IAST [candidate] (27.017 ms) : 0, 27017
Remote Config [baseline] (778.899 µs) : 0, 779
Remote Config [candidate] (786.305 µs) : 0, 786
Telemetry [baseline] (10.254 ms) : 0, 10254
Telemetry [candidate] (9.568 ms) : 0, 9568
section iast
BytebuddyAgent [baseline] (1.177 s) : 0, 1177126
BytebuddyAgent [candidate] (1.175 s) : 0, 1175411
GlobalTracer [baseline] (444.571 ms) : 0, 444571
GlobalTracer [candidate] (445.607 ms) : 0, 445607
AppSec [baseline] (77.248 ms) : 0, 77248
AppSec [candidate] (78.126 ms) : 0, 78126
IAST [baseline] (27.587 ms) : 0, 27587
IAST [candidate] (27.253 ms) : 0, 27253
Remote Config [baseline] (769.276 µs) : 0, 769
Remote Config [candidate] (775.478 µs) : 0, 775
Telemetry [baseline] (9.66 ms) : 0, 9660
Telemetry [candidate] (9.723 ms) : 0, 9723
section profiling
BytebuddyAgent [baseline] (1.008 s) : 0, 1008029
BytebuddyAgent [candidate] (1.008 s) : 0, 1008022
GlobalTracer [baseline] (594.509 ms) : 0, 594509
GlobalTracer [candidate] (594.506 ms) : 0, 594506
AppSec [baseline] (76.291 ms) : 0, 76291
AppSec [candidate] (76.475 ms) : 0, 76475
Remote Config [baseline] (843.49 µs) : 0, 843
Remote Config [candidate] (827.623 µs) : 0, 828
Telemetry [baseline] (13.066 ms) : 0, 13066
Telemetry [candidate] (13.039 ms) : 0, 13039
ProfilingAgent [baseline] (164.512 ms) : 0, 164512
ProfilingAgent [candidate] (166.361 ms) : 0, 166361
Profiling [baseline] (164.567 ms) : 0, 164567
Profiling [candidate] (166.416 ms) : 0, 166416
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-12T09:33:39 2024-11-12T09:40:33
git_branch master bbujon/ci
git_commit_date 1731353240 1731403363
git_commit_sha f19a626 b100bc8
release_version 1.43.0-SNAPSHOT~f19a626f66 1.43.0-SNAPSHOT~b100bc8a16
start_time 2024-11-12T09:33:26 2024-11-12T09:40:20
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731404782 1731404782
ci_job_id 703304645 703304645
ci_pipeline_id 48776743 48776743
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.486 µs) : 352, 393
.   : milestone, 372,
iast (481.937 µs) : 461, 503
.   : milestone, 482,
iast_FULL (644.688 µs) : 623, 666
.   : milestone, 645,
iast_GLOBAL (506.584 µs) : 485, 528
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (485.522 µs) : 464, 507
.   : milestone, 486,
iast_INACTIVE (449.669 µs) : 429, 471
.   : milestone, 450,
iast_TELEMETRY_OFF (477.318 µs) : 455, 500
.   : milestone, 477,
tracing (441.775 µs) : 421, 463
.   : milestone, 442,
section candidate
no_agent (374.439 µs) : 355, 394
.   : milestone, 374,
iast (478.401 µs) : 457, 500
.   : milestone, 478,
iast_FULL (637.964 µs) : 617, 659
.   : milestone, 638,
iast_GLOBAL (522.962 µs) : 500, 546
.   : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (479.893 µs) : 458, 501
.   : milestone, 480,
iast_INACTIVE (452.669 µs) : 431, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (474.791 µs) : 454, 496
.   : milestone, 475,
tracing (445.276 µs) : 424, 466
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.486 µs [351.718 µs, 393.253 µs] -
iast 481.937 µs [460.775 µs, 503.1 µs] 109.452 µs (29.4%)
iast_FULL 644.688 µs [623.331 µs, 666.045 µs] 272.202 µs (73.1%)
iast_GLOBAL 506.584 µs [485.462 µs, 527.705 µs] 134.098 µs (36.0%)
iast_HARDCODED_SECRET_DISABLED 485.522 µs [463.985 µs, 507.06 µs] 113.037 µs (30.3%)
iast_INACTIVE 449.669 µs [428.714 µs, 470.624 µs] 77.183 µs (20.7%)
iast_TELEMETRY_OFF 477.318 µs [454.873 µs, 499.763 µs] 104.833 µs (28.1%)
tracing 441.775 µs [420.985 µs, 462.566 µs] 69.29 µs (18.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.439 µs [354.912 µs, 393.966 µs] -
iast 478.401 µs [457.106 µs, 499.696 µs] 103.962 µs (27.8%)
iast_FULL 637.964 µs [616.652 µs, 659.277 µs] 263.525 µs (70.4%)
iast_GLOBAL 522.962 µs [500.1 µs, 545.825 µs] 148.523 µs (39.7%)
iast_HARDCODED_SECRET_DISABLED 479.893 µs [458.46 µs, 501.325 µs] 105.454 µs (28.2%)
iast_INACTIVE 452.669 µs [431.157 µs, 474.182 µs] 78.231 µs (20.9%)
iast_TELEMETRY_OFF 474.791 µs [453.682 µs, 495.901 µs] 100.352 µs (26.8%)
tracing 445.276 µs [424.091 µs, 466.461 µs] 70.837 µs (18.9%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.339 ms) : 1319, 1358
.   : milestone, 1339,
appsec (1.73 ms) : 1706, 1754
.   : milestone, 1730,
appsec_no_iast (1.719 ms) : 1694, 1744
.   : milestone, 1719,
iast (1.474 ms) : 1451, 1497
.   : milestone, 1474,
profiling (1.524 ms) : 1500, 1548
.   : milestone, 1524,
tracing (1.446 ms) : 1421, 1470
.   : milestone, 1446,
section candidate
no_agent (1.329 ms) : 1309, 1348
.   : milestone, 1329,
appsec (1.734 ms) : 1712, 1756
.   : milestone, 1734,
appsec_no_iast (1.744 ms) : 1720, 1768
.   : milestone, 1744,
iast (1.468 ms) : 1445, 1491
.   : milestone, 1468,
profiling (1.481 ms) : 1458, 1504
.   : milestone, 1481,
tracing (1.488 ms) : 1464, 1512
.   : milestone, 1488,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.339 ms [1.319 ms, 1.358 ms] -
appsec 1.73 ms [1.706 ms, 1.754 ms] 390.966 µs (29.2%)
appsec_no_iast 1.719 ms [1.694 ms, 1.744 ms] 379.975 µs (28.4%)
iast 1.474 ms [1.451 ms, 1.497 ms] 135.334 µs (10.1%)
profiling 1.524 ms [1.5 ms, 1.548 ms] 184.878 µs (13.8%)
tracing 1.446 ms [1.421 ms, 1.47 ms] 106.677 µs (8.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.329 ms [1.309 ms, 1.348 ms] -
appsec 1.734 ms [1.712 ms, 1.756 ms] 405.222 µs (30.5%)
appsec_no_iast 1.744 ms [1.72 ms, 1.768 ms] 415.034 µs (31.2%)
iast 1.468 ms [1.445 ms, 1.491 ms] 139.147 µs (10.5%)
profiling 1.481 ms [1.458 ms, 1.504 ms] 152.249 µs (11.5%)
tracing 1.488 ms [1.464 ms, 1.512 ms] 159.005 µs (12.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1731353240 1731403363
git_commit_sha f19a626 b100bc8
release_version 1.43.0-SNAPSHOT~f19a626f66 1.43.0-SNAPSHOT~b100bc8a16
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1731405296 1731405296
ci_job_id 703304646 703304646
ci_pipeline_id 48776743 48776743
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.459 ms) : 1447, 1470
.   : milestone, 1459,
appsec (2.324 ms) : 2282, 2365
.   : milestone, 2324,
iast (2.063 ms) : 2011, 2115
.   : milestone, 2063,
iast_GLOBAL (2.12 ms) : 2067, 2173
.   : milestone, 2120,
profiling (1.942 ms) : 1900, 1984
.   : milestone, 1942,
tracing (1.908 ms) : 1868, 1947
.   : milestone, 1908,
section candidate
no_agent (1.463 ms) : 1452, 1475
.   : milestone, 1463,
appsec (2.33 ms) : 2289, 2372
.   : milestone, 2330,
iast (2.078 ms) : 2026, 2131
.   : milestone, 2078,
iast_GLOBAL (2.108 ms) : 2056, 2161
.   : milestone, 2108,
profiling (1.935 ms) : 1893, 1976
.   : milestone, 1935,
tracing (1.92 ms) : 1879, 1961
.   : milestone, 1920,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.447 ms, 1.47 ms] -
appsec 2.324 ms [2.282 ms, 2.365 ms] 864.768 µs (59.3%)
iast 2.063 ms [2.011 ms, 2.115 ms] 604.351 µs (41.4%)
iast_GLOBAL 2.12 ms [2.067 ms, 2.173 ms] 661.087 µs (45.3%)
profiling 1.942 ms [1.9 ms, 1.984 ms] 482.823 µs (33.1%)
tracing 1.908 ms [1.868 ms, 1.947 ms] 448.871 µs (30.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.475 ms] -
appsec 2.33 ms [2.289 ms, 2.372 ms] 867.271 µs (59.3%)
iast 2.078 ms [2.026 ms, 2.131 ms] 615.19 µs (42.0%)
iast_GLOBAL 2.108 ms [2.056 ms, 2.161 ms] 645.174 µs (44.1%)
profiling 1.935 ms [1.893 ms, 1.976 ms] 471.649 µs (32.2%)
tracing 1.92 ms [1.879 ms, 1.961 ms] 456.794 µs (31.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.452 s) : 15452000, 15452000
.   : milestone, 15452000,
appsec (15.158 s) : 15158000, 15158000
.   : milestone, 15158000,
iast (19.116 s) : 19116000, 19116000
.   : milestone, 19116000,
iast_GLOBAL (18.022 s) : 18022000, 18022000
.   : milestone, 18022000,
profiling (15.616 s) : 15616000, 15616000
.   : milestone, 15616000,
tracing (15.235 s) : 15235000, 15235000
.   : milestone, 15235000,
section candidate
no_agent (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
appsec (15.192 s) : 15192000, 15192000
.   : milestone, 15192000,
iast (18.667 s) : 18667000, 18667000
.   : milestone, 18667000,
iast_GLOBAL (18.009 s) : 18009000, 18009000
.   : milestone, 18009000,
profiling (15.635 s) : 15635000, 15635000
.   : milestone, 15635000,
tracing (15.12 s) : 15120000, 15120000
.   : milestone, 15120000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.452 s [15.452 s, 15.452 s] -
appsec 15.158 s [15.158 s, 15.158 s] -294.0 ms (-1.9%)
iast 19.116 s [19.116 s, 19.116 s] 3.664 s (23.7%)
iast_GLOBAL 18.022 s [18.022 s, 18.022 s] 2.57 s (16.6%)
profiling 15.616 s [15.616 s, 15.616 s] 164.0 ms (1.1%)
tracing 15.235 s [15.235 s, 15.235 s] -217.0 ms (-1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.087 s [15.087 s, 15.087 s] -
appsec 15.192 s [15.192 s, 15.192 s] 105.0 ms (0.7%)
iast 18.667 s [18.667 s, 18.667 s] 3.58 s (23.7%)
iast_GLOBAL 18.009 s [18.009 s, 18.009 s] 2.922 s (19.4%)
profiling 15.635 s [15.635 s, 15.635 s] 548.0 ms (3.6%)
tracing 15.12 s [15.12 s, 15.12 s] 33.0 ms (0.2%)

@PerfectSlayer PerfectSlayer merged commit a58298f into master Nov 12, 2024
101 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch November 12, 2024 12:05
@github-actions github-actions bot added this to the 1.43.0 milestone Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants