Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: add agent info endpoint malfunctioning test cases #891

Merged
merged 3 commits into from
Feb 20, 2025

Conversation

ganeshnj
Copy link
Contributor

What does this PR do?

.NET has test cases which verify the behavior of traces endpoint, that it works even other endpoints could be having problems like config, telemetry or remote config.

This PR to add similar level of testing coverage.

Motivation

https://github.com/DataDog/dd-trace-dotnet/blob/4d06db4f8b87670fbfaf3e582198b3d9e74dc8bd/tracer/test/Datadog.Trace.ClrProfiler.IntegrationTests/AgentMalfunctionTests.cs#L54-L55

Additional Notes

None

How to test the change?

No implementation changes, only more test coverage.

.NET has test cases which verify the behavior of traces endpoint, that it works even other endpoints could be having problems like config, telemetry or remote config.

This PR to add similar level of testing coverage.
@ganeshnj ganeshnj requested a review from a team as a code owner February 20, 2025 12:58
@codecov-commenter
Copy link

codecov-commenter commented Feb 20, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.72%. Comparing base (0957884) to head (2ab082a).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #891      +/-   ##
==========================================
+ Coverage   71.67%   71.72%   +0.05%     
==========================================
  Files         328      328              
  Lines       48413    48485      +72     
==========================================
+ Hits        34699    34778      +79     
+ Misses      13714    13707       -7     
Components Coverage Δ
crashtracker 42.90% <ø> (ø)
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.07% <100.00%> (+0.12%) ⬆️
data-pipeline-ffi 90.39% <ø> (ø)
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 80.04% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.52% <ø> (ø)
sidecar-ffi 2.05% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 92.85% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 78.13% <ø> (ø)
trace-utils 93.30% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Feb 20, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-20 14:43:30

Comparing candidate commit 2ab082a in PR branch ganeshnj/test/agent-malfunction-info with baseline commit eb23407 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+2.940ms; +3.001ms] or [+5.457%; +5.570%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.840µs 66.058µs ± 0.294µs 66.030µs ± 0.050µs 66.079µs 66.184µs 66.432µs 70.020µs 6.04% 12.317 162.862 0.44% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.018µs; 66.099µs] or [-0.062%; +0.062%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 56.652ms 56.836ms ± 0.145ms 56.804ms ± 0.054ms 56.865ms 57.081ms 57.447ms 57.725ms 1.62% 3.169 13.847 0.26% 0.010ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [56.816ms; 56.856ms] or [-0.035%; +0.035%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.965ms 5.981ms ± 0.011ms 5.980ms ± 0.002ms 5.982ms 5.987ms 6.005ms 6.118ms 2.31% 10.068 121.661 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.979ms; 5.982ms] or [-0.025%; +0.025%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.200µs 3.195µs ± 1.537µs 2.994µs ± 0.029µs 3.023µs 3.617µs 13.796µs 17.552µs 486.26% 7.720 61.334 47.98% 0.109µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.982µs; 3.408µs] or [-6.667%; +6.667%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.940µs 33.412µs ± 0.814µs 33.047µs ± 0.054µs 33.146µs 35.057µs 35.084µs 37.921µs 14.75% 2.124 4.483 2.43% 0.058µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.299µs; 33.525µs] or [-0.338%; +0.338%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.728ns 253.509ns ± 10.650ns 248.163ns ± 2.373ns 257.562ns 276.733ns 282.318ns 283.891ns 14.40% 1.405 0.666 4.19% 0.753ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.033ns; 254.985ns] or [-0.582%; +0.582%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.897µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.918µs 3.919µs 0.15% -1.514 8.525 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255162447.435op/s 255563880.891op/s ± 160671.451op/s 255552633.325op/s ± 78069.847op/s 255629755.306op/s 255831211.329op/s 255953652.194op/s 256620038.993op/s 0.42% 1.529 8.633 0.06% 11361.187op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.289µs 82.768µs ± 0.618µs 82.800µs ± 0.431µs 83.229µs 83.748µs 83.980µs 84.383µs 1.91% -0.083 -0.410 0.74% 0.044µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11850788.087op/s 12082669.089op/s ± 90298.481op/s 12077258.826op/s ± 63059.371op/s 12140596.975op/s 12245965.235op/s 12275920.510op/s 12301811.018op/s 1.86% 0.119 -0.407 0.75% 6385.067op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 78.386µs 79.509µs ± 0.394µs 79.572µs ± 0.247µs 79.762µs 80.103µs 80.287µs 80.533µs 1.21% -0.348 -0.118 0.49% 0.028µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12417218.948op/s 12577459.204op/s ± 62377.099op/s 12567199.264op/s ± 39100.632op/s 12621649.604op/s 12690727.085op/s 12725858.321op/s 12757325.040op/s 1.51% 0.374 -0.099 0.49% 4410.727op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.899µs 3.914µs ± 0.002µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.920µs 3.923µs 0.23% -0.603 8.761 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254916318.106op/s 255491855.343op/s ± 157430.341op/s 255513031.172op/s ± 74600.460op/s 255571451.389op/s 255688345.163op/s 255853335.003op/s 256503647.472op/s 0.39% 0.623 8.861 0.06% 11132.006op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 74.575µs 76.188µs ± 0.451µs 76.224µs ± 0.308µs 76.471µs 76.954µs 77.098µs 77.160µs 1.23% -0.217 0.035 0.59% 0.032µs 1 200
credit_card/is_card_number/378282246310005 throughput 12960131.298op/s 13125811.207op/s ± 77799.213op/s 13119215.160op/s ± 53141.992op/s 13184324.966op/s 13249563.715op/s 13292204.177op/s 13409281.336op/s 2.21% 0.252 0.087 0.59% 5501.235op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.359µs 51.432µs ± 0.026µs 51.431µs ± 0.013µs 51.444µs 51.472µs 51.499µs 51.577µs 0.29% 0.909 4.816 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19388390.729op/s 19443075.955op/s ± 9761.587op/s 19443682.346op/s ± 5088.256op/s 19448412.116op/s 19457978.649op/s 19465426.465op/s 19470657.719op/s 0.14% -0.900 4.775 0.05% 690.248op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.030µs 6.038µs ± 0.003µs 6.037µs ± 0.002µs 6.039µs 6.043µs 6.047µs 6.052µs 0.25% 1.267 3.191 0.05% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165237549.670op/s 165630115.786op/s ± 87518.582op/s 165654196.615op/s ± 42522.590op/s 165684442.234op/s 165735607.467op/s 165797280.563op/s 165838226.162op/s 0.11% -1.261 3.169 0.05% 6188.498op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.918µs 3.919µs 0.16% -2.427 17.446 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255172993.513op/s 255575399.691op/s ± 162445.906op/s 255576959.737op/s ± 78405.386op/s 255634203.860op/s 255854433.162op/s 255942461.535op/s 256844049.840op/s 0.50% 2.453 17.683 0.06% 11486.660op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.802µs 66.158µs ± 0.220µs 66.119µs ± 0.093µs 66.222µs 66.489µs 67.189µs 67.557µs 2.17% 2.950 13.892 0.33% 0.016µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14802384.275op/s 15115510.835op/s ± 49716.989op/s 15124203.542op/s ± 21246.914op/s 15142638.927op/s 15165767.302op/s 15189844.467op/s 15197018.345op/s 0.48% -2.880 13.357 0.33% 3515.522op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.462µs 59.679µs ± 0.089µs 59.675µs ± 0.060µs 59.742µs 59.827µs 59.868µs 59.897µs 0.37% 0.041 -0.466 0.15% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16695381.729op/s 16756438.793op/s ± 25039.533op/s 16757565.655op/s ± 16694.412op/s 16772077.845op/s 16797612.472op/s 16813151.079op/s 16817574.365op/s 0.36% -0.034 -0.466 0.15% 1770.562op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.918µs 3.921µs 0.19% -2.330 16.133 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255064721.176op/s 255556880.379op/s ± 151644.790op/s 255550001.644op/s ± 57781.613op/s 255600089.461op/s 255822719.265op/s 255932513.596op/s 256705837.406op/s 0.45% 2.353 16.319 0.06% 10722.906op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.386µs 56.864µs ± 0.158µs 56.871µs ± 0.113µs 56.974µs 57.104µs 57.162µs 57.185µs 0.55% -0.349 -0.222 0.28% 0.011µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17486959.865op/s 17585921.696op/s ± 48974.997op/s 17583781.753op/s ± 34941.810op/s 17619865.296op/s 17667749.998op/s 17714203.453op/s 17734928.943op/s 0.86% 0.362 -0.204 0.28% 3463.055op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.354µs 51.433µs ± 0.029µs 51.429µs ± 0.013µs 51.443µs 51.487µs 51.518µs 51.575µs 0.28% 1.119 3.471 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19389296.810op/s 19442745.394op/s ± 10895.984op/s 19444298.889op/s ± 5065.931op/s 19448903.355op/s 19457462.972op/s 19468045.384op/s 19472650.662op/s 0.15% -1.112 3.447 0.06% 770.462op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.037µs ± 0.004µs 6.037µs ± 0.002µs 6.039µs 6.044µs 6.050µs 6.063µs 0.43% 1.455 6.830 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164940288.329op/s 165633435.452op/s ± 113870.983op/s 165649935.173op/s ± 45405.926op/s 165687362.804op/s 165805485.231op/s 165873918.716op/s 165894662.099op/s 0.15% -1.442 6.748 0.07% 8051.894op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255541613.373op/s; 255586148.409op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.682µs; 82.853µs] or [-0.103%; +0.103%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12070154.588op/s; 12095183.590op/s] or [-0.104%; +0.104%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [79.455µs; 79.564µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12568814.338op/s; 12586104.070op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255470037.011op/s; 255513673.674op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.126µs; 76.251µs] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/378282246310005 throughput [13115028.984op/s; 13136593.429op/s] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.429µs; 51.436µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19441723.093op/s; 19444428.817op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.038µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 throughput [165617986.553op/s; 165642245.020op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255552886.251op/s; 255597913.131op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.127µs; 66.188µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15108620.539op/s; 15122401.132op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.666µs; 59.691µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16752968.554op/s; 16759909.031op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255535863.870op/s; 255577896.889op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.842µs; 56.886µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17579134.233op/s; 17592709.160op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.429µs; 51.437µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19441235.316op/s; 19444255.473op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.038µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165617654.029op/s; 165649216.876op/s] or [-0.010%; +0.010%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.489µs 505.744µs ± 0.508µs 505.695µs ± 0.251µs 506.008µs 506.503µs 506.867µs 509.622µs 0.78% 2.332 15.787 0.10% 0.036µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1962238.893op/s 1977285.200op/s ± 1983.267op/s 1977477.411op/s ± 982.693op/s 1978274.534op/s 1980015.244op/s 1980929.303op/s 1982202.247op/s 0.24% -2.295 15.449 0.10% 140.238op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.608µs 453.543µs ± 0.300µs 453.537µs ± 0.167µs 453.703µs 454.107µs 454.279µs 454.449µs 0.20% 0.053 0.620 0.07% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2200465.729op/s 2204864.610op/s ± 1460.306op/s 2204889.707op/s ± 811.147op/s 2205708.755op/s 2207270.978op/s 2208471.352op/s 2209418.641op/s 0.21% -0.047 0.621 0.07% 103.259op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.619µs 176.602µs ± 0.630µs 176.606µs ± 0.262µs 176.844µs 177.116µs 177.362µs 181.824µs 2.95% 5.290 41.651 0.36% 0.045µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5499824.006op/s 5662515.360op/s ± 19826.299op/s 5662325.300op/s ± 8400.635op/s 5672594.909op/s 5684333.082op/s 5691454.502op/s 5694160.527op/s 0.56% -5.124 39.961 0.35% 1401.931op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.571µs 37.716µs ± 0.054µs 37.716µs ± 0.036µs 37.750µs 37.802µs 37.848µs 37.909µs 0.51% 0.381 0.561 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26378783.164op/s 26513908.331op/s ± 37842.200op/s 26514275.491op/s ± 25460.546op/s 26541292.556op/s 26567394.915op/s 26594599.055op/s 26616113.487op/s 0.38% -0.371 0.545 0.14% 2675.848op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.209µs 48.306µs ± 0.040µs 48.306µs ± 0.026µs 48.333µs 48.365µs 48.400µs 48.515µs 0.43% 0.647 2.729 0.08% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20612321.812op/s 20701359.951op/s ± 17308.740op/s 20701367.022op/s ± 11011.708op/s 20712126.450op/s 20730324.137op/s 20734045.780op/s 20743137.027op/s 0.20% -0.636 2.682 0.08% 1223.913op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.674µs; 505.815µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977010.338op/s; 1977560.062op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.501µs; 453.584µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2204662.226op/s; 2205066.995op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.515µs; 176.689µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5659767.625op/s; 5665263.094op/s] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.709µs; 37.724µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26508663.766op/s; 26519152.896op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.300µs; 48.312µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20698961.126op/s; 20703758.776op/s] or [-0.012%; +0.012%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.419µs 2.456µs ± 0.026µs 2.447µs ± 0.009µs 2.464µs 2.503µs 2.516µs 2.668µs 9.01% 3.147 19.034 1.08% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.453µs; 2.460µs] or [-0.149%; +0.149%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.682µs 209.035µs ± 0.146µs 209.044µs ± 0.096µs 209.123µs 209.278µs 209.353µs 209.601µs 0.27% 0.286 0.560 0.07% 0.010µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4770977.192op/s 4783893.857op/s ± 3348.481op/s 4783679.680op/s ± 2193.330op/s 4786326.901op/s 4789229.374op/s 4791240.845op/s 4791973.763op/s 0.17% -0.281 0.550 0.07% 236.773op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.281µs 18.337µs ± 0.031µs 18.332µs ± 0.014µs 18.355µs 18.375µs 18.400µs 18.619µs 1.56% 3.765 31.822 0.17% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53709946.263op/s 54533632.443op/s ± 91824.012op/s 54550178.305op/s ± 42790.636op/s 54582735.227op/s 54653849.410op/s 54688599.643op/s 54700436.306op/s 0.28% -3.667 30.677 0.17% 6492.938op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.671µs 10.721µs ± 0.022µs 10.716µs ± 0.013µs 10.736µs 10.759µs 10.778µs 10.809µs 0.87% 0.611 0.585 0.21% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92514047.902op/s 93270942.009op/s ± 195078.874op/s 93321182.446op/s ± 110166.860op/s 93397111.587op/s 93534348.338op/s 93662897.336op/s 93711929.529op/s 0.42% -0.597 0.554 0.21% 13794.159op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.015µs; 209.055µs] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4783429.789op/s; 4784357.924op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.333µs; 18.342µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54520906.519op/s; 54546358.368op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.718µs; 10.725µs] or [-0.029%; +0.029%] None None None
normalization/normalize_name/normalize_name/good throughput [93243905.953op/s; 93297978.065op/s] or [-0.029%; +0.029%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 149.283µs 149.852µs ± 0.377µs 149.751µs ± 0.145µs 149.934µs 150.663µs 151.049µs 151.740µs 1.33% 2.081 5.625 0.25% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.800µs; 149.904µs] or [-0.035%; +0.035%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.161µs 26.895µs ± 10.959µs 18.881µs ± 0.662µs 36.060µs 44.667µs 59.218µs 93.902µs 397.33% 1.690 5.885 40.65% 0.775µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.376µs; 28.413µs] or [-5.647%; +5.647%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2ab082a 1740061990 ganeshnj/test/agent-malfunction-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.989µs 5.064µs ± 0.043µs 5.068µs ± 0.040µs 5.092µs 5.131µs 5.140µs 5.144µs 1.50% -0.037 -1.178 0.85% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.058µs; 5.070µs] or [-0.118%; +0.118%] None None None

Baseline

Omitted due to size.

@ganeshnj ganeshnj merged commit 5c82629 into main Feb 20, 2025
31 checks passed
@ganeshnj ganeshnj deleted the ganeshnj/test/agent-malfunction-info branch February 20, 2025 15:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants