Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add draft inferred proxy spans as http request parent #8336

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

add draft inferred proxy spans as http request parent #8336

wants to merge 2 commits into from

Conversation

jordan-wong
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Feb 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master inferred-span-tags
git_commit_date 1738688431 1738698116
git_commit_sha 312af33 d0aa92b
release_version 1.47.0-SNAPSHOT~312af335ab 1.46.0-SNAPSHOT~d0aa92ba14
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738700644 1738700644
ci_job_id 793970712 793970712
ci_pipeline_id 54889762 54889762
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dpmxkxx9-project-304-concurrent-0-bu6otk4p 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dpmxkxx9-project-304-concurrent-0-bu6otk4p 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 3 performance improvements and 8 performance regressions! Performance is the same for 42 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+10.024ms; +16.577ms] or [+4.261%; +7.047%]		 248.539ms 235.238ms
scenario:startup:insecure-bank:iast:IAST better
[-1.645ms; -0.669ms] or [-7.196%; -2.926%]		 21.708ms 22.865ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracer worse
[+9.062ms; +16.908ms] or [+3.853%; +7.189%]		 248.170ms 235.185ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracer worse
[+7.698ms; +16.677ms] or [+3.262%; +7.066%]		 248.200ms 236.013ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+10.558ms; +13.159ms] or [+4.329%; +5.395%]		 255.785ms 243.926ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+11.348ms; +17.068ms] or [+4.713%; +7.089%]		 254.977ms 240.768ms
scenario:startup:petclinic:appsec:AppSec better
[-5.747ms; -4.146ms] or [-3.251%; -2.346%]		 171.815ms 176.761ms
scenario:startup:petclinic:appsec:IAST better
[-2.396ms; -1.870ms] or [-11.098%; -8.664%]		 19.453ms 21.586ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+9.350ms; +14.702ms] or [+3.984%; +6.264%]		 246.721ms 234.694ms
scenario:startup:petclinic:iast:Remote Config worse
[+24.085µs; +56.703µs] or [+3.924%; +9.238%]		 654.189µs 613.795µs
scenario:startup:petclinic:tracing:GlobalTracer worse
[+7.651ms; +13.756ms] or [+3.128%; +5.625%]		 255.270ms 244.567ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049129
Total [baseline] (10.618 s) : 0, 10618182
Agent [candidate] (1.055 s) : 0, 1055370
Total [candidate] (10.462 s) : 0, 10462363
section appsec
Agent [baseline] (1.185 s) : 0, 1184903
Total [baseline] (10.78 s) : 0, 10780298
Agent [candidate] (1.198 s) : 0, 1198105
Total [candidate] (10.817 s) : 0, 10816587
section iast
Agent [baseline] (1.177 s) : 0, 1177132
Total [baseline] (11.025 s) : 0, 11025210
Agent [candidate] (1.184 s) : 0, 1184355
Total [candidate] (11.03 s) : 0, 11030295
section profiling
Agent [baseline] (1.264 s) : 0, 1263654
Total [baseline] (10.878 s) : 0, 10877737
Agent [candidate] (1.256 s) : 0, 1256282
Total [candidate] (10.902 s) : 0, 10902455
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.185 s 135.773 ms (12.9%)
Agent iast 1.177 s 128.003 ms (12.2%)
Agent profiling 1.264 s 214.525 ms (20.4%)
Total tracing 10.618 s -
Total appsec 10.78 s 162.115 ms (1.5%)
Total iast 11.025 s 407.028 ms (3.8%)
Total profiling 10.878 s 259.554 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.198 s 142.735 ms (13.5%)
Agent iast 1.184 s 128.985 ms (12.2%)
Agent profiling 1.256 s 200.912 ms (19.0%)
Total tracing 10.462 s -
Total appsec 10.817 s 354.224 ms (3.4%)
Total iast 11.03 s 567.932 ms (5.4%)
Total profiling 10.902 s 440.092 ms (4.2%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.451 ms) : 0, 718451
BytebuddyAgent [candidate] (713.176 ms) : 0, 713176
GlobalTracer [baseline] (244.567 ms) : 0, 244567
GlobalTracer [candidate] (255.27 ms) : 0, 255270
AppSec [baseline] (55.64 ms) : 0, 55640
AppSec [candidate] (55.483 ms) : 0, 55483
Remote Config [baseline] (730.383 µs) : 0, 730
Remote Config [candidate] (741.623 µs) : 0, 742
Telemetry [baseline] (14.529 ms) : 0, 14529
Telemetry [candidate] (15.674 ms) : 0, 15674
section appsec
BytebuddyAgent [baseline] (732.434 ms) : 0, 732434
BytebuddyAgent [candidate] (737.214 ms) : 0, 737214
GlobalTracer [baseline] (240.768 ms) : 0, 240768
GlobalTracer [candidate] (254.977 ms) : 0, 254977
AppSec [baseline] (176.761 ms) : 0, 176761
AppSec [candidate] (171.815 ms) : 0, 171815
Remote Config [baseline] (655.07 µs) : 0, 655
Remote Config [candidate] (665.447 µs) : 0, 665
Telemetry [baseline] (8.274 ms) : 0, 8274
Telemetry [candidate] (8.596 ms) : 0, 8596
IAST [baseline] (21.586 ms) : 0, 21586
IAST [candidate] (19.453 ms) : 0, 19453
section iast
BytebuddyAgent [baseline] (838.288 ms) : 0, 838288
BytebuddyAgent [candidate] (833.505 ms) : 0, 833505
GlobalTracer [baseline] (234.694 ms) : 0, 234694
GlobalTracer [candidate] (246.721 ms) : 0, 246721
AppSec [baseline] (53.81 ms) : 0, 53810
AppSec [candidate] (58.192 ms) : 0, 58192
Remote Config [baseline] (613.795 µs) : 0, 614
Remote Config [candidate] (654.189 µs) : 0, 654
Telemetry [baseline] (8.719 ms) : 0, 8719
Telemetry [candidate] (8.748 ms) : 0, 8748
IAST [baseline] (25.65 ms) : 0, 25650
IAST [candidate] (21.46 ms) : 0, 21460
section profiling
ProfilingAgent [baseline] (95.715 ms) : 0, 95715
ProfilingAgent [candidate] (95.445 ms) : 0, 95445
BytebuddyAgent [baseline] (707.043 ms) : 0, 707043
BytebuddyAgent [candidate] (704.569 ms) : 0, 704569
GlobalTracer [baseline] (353.638 ms) : 0, 353638
GlobalTracer [candidate] (350.182 ms) : 0, 350182
AppSec [baseline] (55.29 ms) : 0, 55290
AppSec [candidate] (54.43 ms) : 0, 54430
Remote Config [baseline] (694.907 µs) : 0, 695
Remote Config [candidate] (725.837 µs) : 0, 726
Telemetry [baseline] (8.995 ms) : 0, 8995
Telemetry [candidate] (8.906 ms) : 0, 8906
Profiling [baseline] (95.739 ms) : 0, 95739
Profiling [candidate] (95.469 ms) : 0, 95469
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043752
Total [baseline] (8.676 s) : 0, 8676048
Agent [candidate] (1.059 s) : 0, 1059319
Total [candidate] (8.677 s) : 0, 8677167
section iast
Agent [baseline] (1.18 s) : 0, 1180281
Total [baseline] (9.257 s) : 0, 9256766
Agent [candidate] (1.194 s) : 0, 1193831
Total [candidate] (9.25 s) : 0, 9249726
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1179120
Total [baseline] (9.26 s) : 0, 9259981
Agent [candidate] (1.191 s) : 0, 1191097
Total [candidate] (9.237 s) : 0, 9237476
section iast_TELEMETRY_OFF
Agent [baseline] (1.182 s) : 0, 1182302
Total [baseline] (9.265 s) : 0, 9265477
Agent [candidate] (1.184 s) : 0, 1184456
Total [candidate] (9.286 s) : 0, 9285990
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent iast 1.18 s 136.529 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 135.368 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.182 s 138.55 ms (13.3%)
Total tracing 8.676 s -
Total iast 9.257 s 580.717 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.26 s 583.933 ms (6.7%)
Total iast_TELEMETRY_OFF 9.265 s 589.429 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.194 s 134.512 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.191 s 131.778 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.184 s 125.137 ms (11.8%)
Total tracing 8.677 s -
Total iast 9.25 s 572.559 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.237 s 560.31 ms (6.5%)
Total iast_TELEMETRY_OFF 9.286 s 608.823 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.351 ms) : 0, 717351
BytebuddyAgent [candidate] (718.451 ms) : 0, 718451
GlobalTracer [baseline] (243.926 ms) : 0, 243926
GlobalTracer [candidate] (255.785 ms) : 0, 255785
AppSec [baseline] (55.076 ms) : 0, 55076
AppSec [candidate] (57.022 ms) : 0, 57022
Remote Config [baseline] (720.27 µs) : 0, 720
Remote Config [candidate] (751.007 µs) : 0, 751
Telemetry [baseline] (11.528 ms) : 0, 11528
Telemetry [candidate] (12.234 ms) : 0, 12234
section iast
BytebuddyAgent [baseline] (840.198 ms) : 0, 840198
BytebuddyAgent [candidate] (840.522 ms) : 0, 840522
GlobalTracer [baseline] (235.238 ms) : 0, 235238
GlobalTracer [candidate] (248.539 ms) : 0, 248539
AppSec [baseline] (57.231 ms) : 0, 57231
AppSec [candidate] (58.467 ms) : 0, 58467
IAST [baseline] (22.865 ms) : 0, 22865
IAST [candidate] (21.708 ms) : 0, 21708
Remote Config [baseline] (627.322 µs) : 0, 627
Remote Config [candidate] (654.721 µs) : 0, 655
Telemetry [baseline] (8.803 ms) : 0, 8803
Telemetry [candidate] (8.782 ms) : 0, 8782
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (839.326 ms) : 0, 839326
BytebuddyAgent [candidate] (838.015 ms) : 0, 838015
GlobalTracer [baseline] (235.185 ms) : 0, 235185
GlobalTracer [candidate] (248.17 ms) : 0, 248170
AppSec [baseline] (53.111 ms) : 0, 53111
AppSec [candidate] (58.435 ms) : 0, 58435
IAST [baseline] (26.575 ms) : 0, 26575
IAST [candidate] (21.833 ms) : 0, 21833
Remote Config [baseline] (685.786 µs) : 0, 686
Remote Config [candidate] (683.391 µs) : 0, 683
Telemetry [baseline] (8.765 ms) : 0, 8765
Telemetry [candidate] (8.851 ms) : 0, 8851
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.996 ms) : 0, 841996
BytebuddyAgent [candidate] (832.322 ms) : 0, 832322
GlobalTracer [baseline] (236.013 ms) : 0, 236013
GlobalTracer [candidate] (248.2 ms) : 0, 248200
AppSec [baseline] (54.877 ms) : 0, 54877
AppSec [candidate] (58.268 ms) : 0, 58268
IAST [baseline] (24.714 ms) : 0, 24714
IAST [candidate] (21.206 ms) : 0, 21206
Remote Config [baseline] (625.801 µs) : 0, 626
Remote Config [candidate] (659.68 µs) : 0, 660
Telemetry [baseline] (8.706 ms) : 0, 8706
Telemetry [candidate] (8.723 ms) : 0, 8723
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-04T19:53:59 2025-02-04T20:01:03
git_branch master inferred-span-tags
git_commit_date 1738688431 1738698116
git_commit_sha 312af33 d0aa92b
release_version 1.47.0-SNAPSHOT~312af335ab 1.46.0-SNAPSHOT~d0aa92ba14
start_time 2025-02-04T19:53:45 2025-02-04T20:00:49
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1738699623 1738699623
ci_job_id 793970713 793970713
ci_pipeline_id 54889762 54889762
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-fvygfmf-project-304-concurrent-0-ke1uvc2w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-fvygfmf-project-304-concurrent-0-ke1uvc2w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 15 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL better
[-61.476µs; -14.245µs] or [-11.149%; -2.583%]		 unstable
[-1609.844op/s; +2609.844op/s] or [-21.465%; +34.798%]		 513.550µs 8000.000op/s 551.410µs 7500.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1340, 1378
.   : milestone, 1359,
appsec (1.758 ms) : 1735, 1781
.   : milestone, 1758,
appsec_no_iast (1.76 ms) : 1736, 1784
.   : milestone, 1760,
iast (1.514 ms) : 1489, 1538
.   : milestone, 1514,
profiling (1.533 ms) : 1507, 1558
.   : milestone, 1533,
tracing (1.461 ms) : 1436, 1486
.   : milestone, 1461,
section candidate
no_agent (1.348 ms) : 1328, 1368
.   : milestone, 1348,
appsec (1.75 ms) : 1726, 1774
.   : milestone, 1750,
appsec_no_iast (1.779 ms) : 1756, 1802
.   : milestone, 1779,
iast (1.517 ms) : 1493, 1542
.   : milestone, 1517,
profiling (1.576 ms) : 1551, 1600
.   : milestone, 1576,
tracing (1.489 ms) : 1464, 1514
.   : milestone, 1489,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.34 ms, 1.378 ms] -
appsec 1.758 ms [1.735 ms, 1.781 ms] 398.873 µs (29.3%)
appsec_no_iast 1.76 ms [1.736 ms, 1.784 ms] 400.539 µs (29.5%)
iast 1.514 ms [1.489 ms, 1.538 ms] 154.502 µs (11.4%)
profiling 1.533 ms [1.507 ms, 1.558 ms] 173.579 µs (12.8%)
tracing 1.461 ms [1.436 ms, 1.486 ms] 102.009 µs (7.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.328 ms, 1.368 ms] -
appsec 1.75 ms [1.726 ms, 1.774 ms] 401.628 µs (29.8%)
appsec_no_iast 1.779 ms [1.756 ms, 1.802 ms] 430.872 µs (32.0%)
iast 1.517 ms [1.493 ms, 1.542 ms] 169.319 µs (12.6%)
profiling 1.576 ms [1.551 ms, 1.6 ms] 227.621 µs (16.9%)
tracing 1.489 ms [1.464 ms, 1.514 ms] 140.942 µs (10.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.702 µs) : 353, 394
.   : milestone, 374,
iast (505.974 µs) : 484, 528
.   : milestone, 506,
iast_FULL (741.181 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (551.41 µs) : 530, 573
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (511.208 µs) : 489, 533
.   : milestone, 511,
iast_INACTIVE (457.717 µs) : 437, 479
.   : milestone, 458,
iast_TELEMETRY_OFF (501.313 µs) : 479, 524
.   : milestone, 501,
tracing (457.112 µs) : 436, 478
.   : milestone, 457,
section candidate
no_agent (384.359 µs) : 364, 405
.   : milestone, 384,
iast (495.364 µs) : 474, 517
.   : milestone, 495,
iast_FULL (758.348 µs) : 737, 780
.   : milestone, 758,
iast_GLOBAL (513.55 µs) : 491, 536
.   : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (498.775 µs) : 477, 521
.   : milestone, 499,
iast_INACTIVE (473.39 µs) : 452, 495
.   : milestone, 473,
iast_TELEMETRY_OFF (488.559 µs) : 466, 511
.   : milestone, 489,
tracing (470.815 µs) : 449, 492
.   : milestone, 471,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.702 µs [353.444 µs, 393.959 µs] -
iast 505.974 µs [484.155 µs, 527.794 µs] 132.272 µs (35.4%)
iast_FULL 741.181 µs [719.33 µs, 763.032 µs] 367.479 µs (98.3%)
iast_GLOBAL 551.41 µs [529.618 µs, 573.202 µs] 177.708 µs (47.6%)
iast_HARDCODED_SECRET_DISABLED 511.208 µs [489.124 µs, 533.293 µs] 137.507 µs (36.8%)
iast_INACTIVE 457.717 µs [436.675 µs, 478.759 µs] 84.015 µs (22.5%)
iast_TELEMETRY_OFF 501.313 µs [478.597 µs, 524.029 µs] 127.611 µs (34.1%)
tracing 457.112 µs [436.236 µs, 477.988 µs] 83.411 µs (22.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.359 µs [364.207 µs, 404.511 µs] -
iast 495.364 µs [473.792 µs, 516.937 µs] 111.005 µs (28.9%)
iast_FULL 758.348 µs [736.536 µs, 780.159 µs] 373.989 µs (97.3%)
iast_GLOBAL 513.55 µs [491.451 µs, 535.648 µs] 129.191 µs (33.6%)
iast_HARDCODED_SECRET_DISABLED 498.775 µs [476.675 µs, 520.876 µs] 114.416 µs (29.8%)
iast_INACTIVE 473.39 µs [452.06 µs, 494.72 µs] 89.031 µs (23.2%)
iast_TELEMETRY_OFF 488.559 µs [466.241 µs, 510.878 µs] 104.2 µs (27.1%)
tracing 470.815 µs [449.341 µs, 492.288 µs] 86.456 µs (22.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master inferred-span-tags
git_commit_date 1738688431 1738698116
git_commit_sha 312af33 d0aa92b
release_version 1.47.0-SNAPSHOT~312af335ab 1.46.0-SNAPSHOT~d0aa92ba14
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1738700269 1738700269
ci_job_id 793970714 793970714
ci_pipeline_id 54889762 54889762
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dpmxkxx9-project-304-concurrent-1-xehklqf2 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dpmxkxx9-project-304-concurrent-1-xehklqf2 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 7 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec worse
[+183.514µs; +277.660µs] or [+7.801%; +11.803%]		 2.583ms 2.352ms
scenario:dacapo:tomcat:iast worse
[+500.051µs; +619.794µs] or [+23.878%; +29.596%]		 2.654ms 2.094ms
scenario:dacapo:tomcat:iast_GLOBAL worse
[+445.595µs; +566.056µs] or [+20.767%; +26.381%]		 2.652ms 2.146ms
scenario:dacapo:tomcat:profiling worse
[+618.223µs; +714.896µs] or [+31.449%; +36.366%]		 2.632ms 1.966ms
scenario:dacapo:tomcat:tracing worse
[+502.572µs; +595.137µs] or [+25.755%; +30.499%]		 2.500ms 1.951ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.352 ms) : 2309, 2396
.   : milestone, 2352,
iast (2.094 ms) : 2039, 2149
.   : milestone, 2094,
iast_GLOBAL (2.146 ms) : 2090, 2201
.   : milestone, 2146,
profiling (1.966 ms) : 1922, 2010
.   : milestone, 1966,
tracing (1.951 ms) : 1909, 1994
.   : milestone, 1951,
section candidate
no_agent (1.465 ms) : 1454, 1477
.   : milestone, 1465,
appsec (2.583 ms) : 2539, 2627
.   : milestone, 2583,
iast (2.654 ms) : 2598, 2710
.   : milestone, 2654,
iast_GLOBAL (2.652 ms) : 2595, 2708
.   : milestone, 2652,
profiling (2.632 ms) : 2586, 2678
.   : milestone, 2632,
tracing (2.5 ms) : 2457, 2544
.   : milestone, 2500,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.352 ms [2.309 ms, 2.396 ms] 888.002 µs (60.6%)
iast 2.094 ms [2.039 ms, 2.149 ms] 629.72 µs (43.0%)
iast_GLOBAL 2.146 ms [2.09 ms, 2.201 ms] 681.224 µs (46.5%)
profiling 1.966 ms [1.922 ms, 2.01 ms] 501.353 µs (34.2%)
tracing 1.951 ms [1.909 ms, 1.994 ms] 486.872 µs (33.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.454 ms, 1.477 ms] -
appsec 2.583 ms [2.539 ms, 2.627 ms] 1.118 ms (76.3%)
iast 2.654 ms [2.598 ms, 2.71 ms] 1.189 ms (81.1%)
iast_GLOBAL 2.652 ms [2.595 ms, 2.708 ms] 1.186 ms (80.9%)
profiling 2.632 ms [2.586 ms, 2.678 ms] 1.167 ms (79.6%)
tracing 2.5 ms [2.457 ms, 2.544 ms] 1.035 ms (70.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d0aa92ba14, baseline=1.47.0-SNAPSHOT~312af335ab
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.232 s) : 15232000, 15232000
.   : milestone, 15232000,
appsec (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
iast (18.865 s) : 18865000, 18865000
.   : milestone, 18865000,
iast_GLOBAL (18.049 s) : 18049000, 18049000
.   : milestone, 18049000,
profiling (15.206 s) : 15206000, 15206000
.   : milestone, 15206000,
tracing (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
section candidate
no_agent (15.212 s) : 15212000, 15212000
.   : milestone, 15212000,
appsec (14.799 s) : 14799000, 14799000
.   : milestone, 14799000,
iast (18.467 s) : 18467000, 18467000
.   : milestone, 18467000,
iast_GLOBAL (17.727 s) : 17727000, 17727000
.   : milestone, 17727000,
profiling (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
tracing (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.232 s [15.232 s, 15.232 s] -
appsec 14.916 s [14.916 s, 14.916 s] -316.0 ms (-2.1%)
iast 18.865 s [18.865 s, 18.865 s] 3.633 s (23.9%)
iast_GLOBAL 18.049 s [18.049 s, 18.049 s] 2.817 s (18.5%)
profiling 15.206 s [15.206 s, 15.206 s] -26.0 ms (-0.2%)
tracing 15.084 s [15.084 s, 15.084 s] -148.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.212 s [15.212 s, 15.212 s] -
appsec 14.799 s [14.799 s, 14.799 s] -413.0 ms (-2.7%)
iast 18.467 s [18.467 s, 18.467 s] 3.255 s (21.4%)
iast_GLOBAL 17.727 s [17.727 s, 17.727 s] 2.515 s (16.5%)
profiling 14.988 s [14.988 s, 14.988 s] -224.0 ms (-1.5%)
tracing 15.008 s [15.008 s, 15.008 s] -204.0 ms (-1.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jordan-wong