-
Notifications
You must be signed in to change notification settings - Fork 303
Update CI reports to prod #7922
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.588 s) : 0, 1587809
Total [baseline] (11.901 s) : 0, 11901360
Agent [candidate] (1.586 s) : 0, 1586223
Total [candidate] (11.9 s) : 0, 11900364
section iast
Agent [baseline] (1.754 s) : 0, 1753565
Total [baseline] (12.768 s) : 0, 12767688
Agent [candidate] (1.755 s) : 0, 1755123
Total [candidate] (12.787 s) : 0, 12786651
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.757 s) : 0, 1756831
Total [baseline] (12.749 s) : 0, 12748809
Agent [candidate] (1.756 s) : 0, 1756352
Total [candidate] (12.725 s) : 0, 12725032
section iast_TELEMETRY_OFF
Agent [baseline] (1.755 s) : 0, 1755113
Total [baseline] (12.801 s) : 0, 12800726
Agent [candidate] (1.756 s) : 0, 1756289
Total [candidate] (12.807 s) : 0, 12806763
gantt
title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.014 s) : 0, 1014371
BytebuddyAgent [candidate] (1.013 s) : 0, 1012606
GlobalTracer [baseline] (466.298 ms) : 0, 466298
GlobalTracer [candidate] (465.853 ms) : 0, 465853
AppSec [baseline] (75.427 ms) : 0, 75427
AppSec [candidate] (75.984 ms) : 0, 75984
Remote Config [baseline] (843.737 µs) : 0, 844
Remote Config [candidate] (839.214 µs) : 0, 839
Telemetry [baseline] (10.617 ms) : 0, 10617
Telemetry [candidate] (10.669 ms) : 0, 10669
section iast
BytebuddyAgent [baseline] (1.174 s) : 0, 1174475
BytebuddyAgent [candidate] (1.175 s) : 0, 1175243
GlobalTracer [baseline] (444.327 ms) : 0, 444327
GlobalTracer [candidate] (444.881 ms) : 0, 444881
AppSec [baseline] (77.739 ms) : 0, 77739
AppSec [candidate] (77.092 ms) : 0, 77092
IAST [baseline] (26.602 ms) : 0, 26602
IAST [candidate] (27.385 ms) : 0, 27385
Remote Config [baseline] (746.853 µs) : 0, 747
Remote Config [candidate] (743.126 µs) : 0, 743
Telemetry [baseline] (9.495 ms) : 0, 9495
Telemetry [candidate] (9.454 ms) : 0, 9454
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.177 s) : 0, 1176651
BytebuddyAgent [candidate] (1.176 s) : 0, 1176020
GlobalTracer [baseline] (444.628 ms) : 0, 444628
GlobalTracer [candidate] (445.016 ms) : 0, 445016
AppSec [baseline] (75.776 ms) : 0, 75776
AppSec [candidate] (78.405 ms) : 0, 78405
IAST [baseline] (29.249 ms) : 0, 29249
IAST [candidate] (26.313 ms) : 0, 26313
Remote Config [baseline] (740.92 µs) : 0, 741
Remote Config [candidate] (723.716 µs) : 0, 724
Telemetry [baseline] (9.572 ms) : 0, 9572
Telemetry [candidate] (9.458 ms) : 0, 9458
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.174 s) : 0, 1173506
BytebuddyAgent [candidate] (1.175 s) : 0, 1175206
GlobalTracer [baseline] (445.419 ms) : 0, 445419
GlobalTracer [candidate] (445.671 ms) : 0, 445671
AppSec [baseline] (77.523 ms) : 0, 77523
AppSec [candidate] (78.081 ms) : 0, 78081
IAST [baseline] (28.303 ms) : 0, 28303
IAST [candidate] (26.665 ms) : 0, 26665
Remote Config [baseline] (742.504 µs) : 0, 743
Remote Config [candidate] (757.792 µs) : 0, 758
Telemetry [baseline] (9.386 ms) : 0, 9386
Telemetry [candidate] (9.573 ms) : 0, 9573
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.59 s) : 0, 1590006
Total [baseline] (14.391 s) : 0, 14390523
Agent [candidate] (1.587 s) : 0, 1586606
Total [candidate] (14.324 s) : 0, 14323731
section appsec
Agent [baseline] (1.788 s) : 0, 1788233
Total [baseline] (14.597 s) : 0, 14597251
Agent [candidate] (1.791 s) : 0, 1791073
Total [candidate] (14.694 s) : 0, 14693984
section iast
Agent [baseline] (1.757 s) : 0, 1757191
Total [baseline] (14.857 s) : 0, 14857185
Agent [candidate] (1.757 s) : 0, 1757239
Total [candidate] (14.954 s) : 0, 14954151
section profiling
Agent [baseline] (1.915 s) : 0, 1915157
Total [baseline] (14.744 s) : 0, 14744312
Agent [candidate] (1.917 s) : 0, 1917198
Total [candidate] (14.687 s) : 0, 14686852
gantt
title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (1.015 s) : 0, 1014980
BytebuddyAgent [candidate] (1.013 s) : 0, 1012634
GlobalTracer [baseline] (466.607 ms) : 0, 466607
GlobalTracer [candidate] (465.695 ms) : 0, 465695
AppSec [baseline] (75.928 ms) : 0, 75928
AppSec [candidate] (75.81 ms) : 0, 75810
Remote Config [baseline] (821.985 µs) : 0, 822
Remote Config [candidate] (828.512 µs) : 0, 829
Telemetry [baseline] (11.395 ms) : 0, 11395
Telemetry [candidate] (11.369 ms) : 0, 11369
section appsec
BytebuddyAgent [baseline] (1.039 s) : 0, 1038526
BytebuddyAgent [candidate] (1.039 s) : 0, 1039485
GlobalTracer [baseline] (462.551 ms) : 0, 462551
GlobalTracer [candidate] (463.478 ms) : 0, 463478
AppSec [baseline] (243.355 ms) : 0, 243355
AppSec [candidate] (243.953 ms) : 0, 243953
IAST [baseline] (25.168 ms) : 0, 25168
IAST [candidate] (27.017 ms) : 0, 27017
Remote Config [baseline] (778.899 µs) : 0, 779
Remote Config [candidate] (786.305 µs) : 0, 786
Telemetry [baseline] (10.254 ms) : 0, 10254
Telemetry [candidate] (9.568 ms) : 0, 9568
section iast
BytebuddyAgent [baseline] (1.177 s) : 0, 1177126
BytebuddyAgent [candidate] (1.175 s) : 0, 1175411
GlobalTracer [baseline] (444.571 ms) : 0, 444571
GlobalTracer [candidate] (445.607 ms) : 0, 445607
AppSec [baseline] (77.248 ms) : 0, 77248
AppSec [candidate] (78.126 ms) : 0, 78126
IAST [baseline] (27.587 ms) : 0, 27587
IAST [candidate] (27.253 ms) : 0, 27253
Remote Config [baseline] (769.276 µs) : 0, 769
Remote Config [candidate] (775.478 µs) : 0, 775
Telemetry [baseline] (9.66 ms) : 0, 9660
Telemetry [candidate] (9.723 ms) : 0, 9723
section profiling
BytebuddyAgent [baseline] (1.008 s) : 0, 1008029
BytebuddyAgent [candidate] (1.008 s) : 0, 1008022
GlobalTracer [baseline] (594.509 ms) : 0, 594509
GlobalTracer [candidate] (594.506 ms) : 0, 594506
AppSec [baseline] (76.291 ms) : 0, 76291
AppSec [candidate] (76.475 ms) : 0, 76475
Remote Config [baseline] (843.49 µs) : 0, 843
Remote Config [candidate] (827.623 µs) : 0, 828
Telemetry [baseline] (13.066 ms) : 0, 13066
Telemetry [candidate] (13.039 ms) : 0, 13039
ProfilingAgent [baseline] (164.512 ms) : 0, 164512
ProfilingAgent [candidate] (166.361 ms) : 0, 166361
Profiling [baseline] (164.567 ms) : 0, 164567
Profiling [candidate] (166.416 ms) : 0, 166416
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section baseline
no_agent (372.486 µs) : 352, 393
. : milestone, 372,
iast (481.937 µs) : 461, 503
. : milestone, 482,
iast_FULL (644.688 µs) : 623, 666
. : milestone, 645,
iast_GLOBAL (506.584 µs) : 485, 528
. : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (485.522 µs) : 464, 507
. : milestone, 486,
iast_INACTIVE (449.669 µs) : 429, 471
. : milestone, 450,
iast_TELEMETRY_OFF (477.318 µs) : 455, 500
. : milestone, 477,
tracing (441.775 µs) : 421, 463
. : milestone, 442,
section candidate
no_agent (374.439 µs) : 355, 394
. : milestone, 374,
iast (478.401 µs) : 457, 500
. : milestone, 478,
iast_FULL (637.964 µs) : 617, 659
. : milestone, 638,
iast_GLOBAL (522.962 µs) : 500, 546
. : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (479.893 µs) : 458, 501
. : milestone, 480,
iast_INACTIVE (452.669 µs) : 431, 474
. : milestone, 453,
iast_TELEMETRY_OFF (474.791 µs) : 454, 496
. : milestone, 475,
tracing (445.276 µs) : 424, 466
. : milestone, 445,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section baseline
no_agent (1.339 ms) : 1319, 1358
. : milestone, 1339,
appsec (1.73 ms) : 1706, 1754
. : milestone, 1730,
appsec_no_iast (1.719 ms) : 1694, 1744
. : milestone, 1719,
iast (1.474 ms) : 1451, 1497
. : milestone, 1474,
profiling (1.524 ms) : 1500, 1548
. : milestone, 1524,
tracing (1.446 ms) : 1421, 1470
. : milestone, 1446,
section candidate
no_agent (1.329 ms) : 1309, 1348
. : milestone, 1329,
appsec (1.734 ms) : 1712, 1756
. : milestone, 1734,
appsec_no_iast (1.744 ms) : 1720, 1768
. : milestone, 1744,
iast (1.468 ms) : 1445, 1491
. : milestone, 1468,
profiling (1.481 ms) : 1458, 1504
. : milestone, 1481,
tracing (1.488 ms) : 1464, 1512
. : milestone, 1488,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section baseline
no_agent (1.459 ms) : 1447, 1470
. : milestone, 1459,
appsec (2.324 ms) : 2282, 2365
. : milestone, 2324,
iast (2.063 ms) : 2011, 2115
. : milestone, 2063,
iast_GLOBAL (2.12 ms) : 2067, 2173
. : milestone, 2120,
profiling (1.942 ms) : 1900, 1984
. : milestone, 1942,
tracing (1.908 ms) : 1868, 1947
. : milestone, 1908,
section candidate
no_agent (1.463 ms) : 1452, 1475
. : milestone, 1463,
appsec (2.33 ms) : 2289, 2372
. : milestone, 2330,
iast (2.078 ms) : 2026, 2131
. : milestone, 2078,
iast_GLOBAL (2.108 ms) : 2056, 2161
. : milestone, 2108,
profiling (1.935 ms) : 1893, 1976
. : milestone, 1935,
tracing (1.92 ms) : 1879, 1961
. : milestone, 1920,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~b100bc8a16, baseline=1.43.0-SNAPSHOT~f19a626f66
dateFormat X
axisFormat %s
section baseline
no_agent (15.452 s) : 15452000, 15452000
. : milestone, 15452000,
appsec (15.158 s) : 15158000, 15158000
. : milestone, 15158000,
iast (19.116 s) : 19116000, 19116000
. : milestone, 19116000,
iast_GLOBAL (18.022 s) : 18022000, 18022000
. : milestone, 18022000,
profiling (15.616 s) : 15616000, 15616000
. : milestone, 15616000,
tracing (15.235 s) : 15235000, 15235000
. : milestone, 15235000,
section candidate
no_agent (15.087 s) : 15087000, 15087000
. : milestone, 15087000,
appsec (15.192 s) : 15192000, 15192000
. : milestone, 15192000,
iast (18.667 s) : 18667000, 18667000
. : milestone, 18667000,
iast_GLOBAL (18.009 s) : 18009000, 18009000
. : milestone, 18009000,
profiling (15.635 s) : 15635000, 15635000
. : milestone, 15635000,
tracing (15.12 s) : 15120000, 15120000
. : milestone, 15120000,
|
smola
approved these changes
Nov 11, 2024
452933b
to
b100bc8
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: tooling
Build & Tooling
tag: no release notes
Changes to exclude from release notes
type: enhancement
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR sends tests and static analysis result reports to Datadog production environment.
Motivation
This was previously set up for staging, but all the repositories moved to production.
In order to have a complete view of the different projects and CI, this uploads the results to the production environment.
Additional Notes
We will still send data to the staging environment to benefit from staging features.
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: APMSP-1519