Enable integer and float interface type tests#261
Open
PhilippGrulich wants to merge 1 commit into
Open
Conversation
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Tracing Benchmark
Details
| Benchmark suite | Current: e6859de | Previous: 10a6635 | Ratio |
|---|---|---|---|
ssa_add |
201.245 ns (± 19.2197) |
204.202 ns (± 28.1667) |
0.99 |
ssa_ifThenElse |
472.595 ns (± 40.7041) |
484.779 ns (± 51.85) |
0.97 |
ssa_deeplyNestedIfElse |
1.15544 us (± 77.0426) |
1.20907 us (± 105.009) |
0.96 |
ssa_loop |
509.776 ns (± 74.2669) |
533.363 ns (± 80.3068) |
0.96 |
ssa_ifInsideLoop |
896.031 ns (± 65.2973) |
959.38 ns (± 91.9966) |
0.93 |
ssa_loopDirectCall |
500.756 ns (± 36.9791) |
538.332 ns (± 83.9372) |
0.93 |
ssa_pointerLoop |
590.375 ns (± 38.8797) |
612.761 ns (± 60.7414) |
0.96 |
ssa_staticLoop |
462.769 ns (± 28.741) |
475.509 ns (± 52.7257) |
0.97 |
ssa_fibonacci |
508.15 ns (± 32.8368) |
530.832 ns (± 47.7214) |
0.96 |
ssa_gcd |
450.444 ns (± 28.7807) |
468.824 ns (± 43.3429) |
0.96 |
e2e_tiered_bc_to_mlir |
51.2525 us (± 13.5235) |
56.5271 us (± 14.5799) |
0.91 |
e2e_single_mlir |
5.8751 ms (± 419.644) |
5.53847 ms (± 193.361) |
1.06 |
exec_mlir_add |
10.4083 ns (± 1.77151) |
10.7701 ns (± 1.25718) |
0.97 |
exec_mlir_fibonacci |
15.826 us (± 1.99625) |
13.3631 us (± 1.67729) |
1.18 |
exec_mlir_sum |
587.42 us (± 31.164) |
513.173 us (± 15.8951) |
1.14 |
exec_cpp_add |
4.73945 ns (± 0.598252) |
4.84074 ns (± 0.975486) |
0.98 |
exec_cpp_fibonacci |
97.1359 us (± 10.3713) |
97.148 us (± 14.5938) |
1.00 |
exec_cpp_sum |
36.0716 ms (± 550.36) |
35.9689 ms (± 194.582) |
1.00 |
exec_bc_add |
42.8255 ns (± 4.51717) |
43.5894 ns (± 5.2732) |
0.98 |
exec_bc_fibonacci |
749.674 us (± 10.0987) |
753.817 us (± 16.9593) |
0.99 |
exec_bc_sum |
163.349 ms (± 1.1273) |
163.437 ms (± 1.52509) |
1.00 |
exec_asmjit_add |
3.49927 ns (± 0.415726) |
3.59554 ns (± 0.522867) |
0.97 |
exec_asmjit_fibonacci |
20.635 us (± 2.10125) |
20.7515 us (± 1.80854) |
0.99 |
exec_asmjit_sum |
4.85173 ms (± 51.364) |
4.84254 ms (± 26.3078) |
1.00 |
exec_bc_add_noRegAlloc |
47.8874 ns (± 11.1116) |
44.3788 ns (± 6.39372) |
1.08 |
exec_bc_add_regAlloc |
43.1076 ns (± 6.45526) |
43.9551 ns (± 5.99039) |
0.98 |
exec_bc_fibonacci_noRegAlloc |
751.538 us (± 15.5738) |
751.654 us (± 14.3443) |
1.00 |
exec_bc_fibonacci_regAlloc |
751.6 us (± 11.734) |
751.761 us (± 11.6866) |
1.00 |
exec_bc_sum_noRegAlloc |
163.898 ms (± 2.91912) |
163.167 ms (± 446.848) |
1.00 |
exec_bc_sum_regAlloc |
163.684 ms (± 2.5936) |
163.266 ms (± 1.17473) |
1.00 |
tiered_compile_addOne |
55.3041 us (± 15.289) |
55.7034 us (± 13.3607) |
0.99 |
single_compile_mlir_addOne |
3.31975 ms (± 107.111) |
3.28567 ms (± 103.998) |
1.01 |
single_compile_cpp_addOne |
26.8189 ms (± 395.18) |
25.0471 ms (± 510.067) |
1.07 |
single_compile_bc_addOne |
56.8918 us (± 15.3124) |
56.0618 us (± 12.9099) |
1.01 |
tiered_compile_sumLoop |
77.1508 us (± 15.5649) |
77.4694 us (± 16.0654) |
1.00 |
single_compile_mlir_sumLoop |
5.45422 ms (± 143.641) |
5.30892 ms (± 116.288) |
1.03 |
single_compile_cpp_sumLoop |
27.6937 ms (± 1.51827) |
25.7075 ms (± 518.009) |
1.08 |
single_compile_bc_sumLoop |
78.4494 us (± 15.8535) |
77.1814 us (± 14.9321) |
1.02 |
exec_bc_addOne |
36.1853 ns (± 6.4493) |
37.3468 ns (± 8.00576) |
0.97 |
exec_mlir_addOne |
272.515 ns (± 15.2786) |
258.029 ns (± 4.30464) |
1.06 |
exec_cpp_addOne |
3.60755 ns (± 0.200763) |
3.6505 ns (± 0.452295) |
0.99 |
exec_interpreted_addOne |
38.0292 ns (± 1.86372) |
38.3209 ns (± 4.07534) |
0.99 |
ir_add |
741.883 ns (± 48.4148) |
772.195 ns (± 71.3318) |
0.96 |
ir_ifThenElse |
1.5311 us (± 75.6598) |
1.61196 us (± 182.266) |
0.95 |
ir_deeplyNestedIfElse |
3.28188 us (± 222.722) |
3.38468 us (± 292.836) |
0.97 |
ir_loop |
1.61059 us (± 119.519) |
1.65684 us (± 243.329) |
0.97 |
ir_ifInsideLoop |
2.76787 us (± 190.378) |
2.89326 us (± 320.554) |
0.96 |
ir_loopDirectCall |
1.75963 us (± 112.377) |
1.81889 us (± 168.556) |
0.97 |
ir_pointerLoop |
1.94127 us (± 132.768) |
2.05088 us (± 272.65) |
0.95 |
ir_staticLoop |
1.51003 us (± 309.786) |
1.51351 us (± 200.357) |
1.00 |
ir_fibonacci |
1.70252 us (± 136.921) |
1.77363 us (± 155.603) |
0.96 |
ir_gcd |
1.46099 us (± 122.485) |
1.56065 us (± 170.558) |
0.94 |
ir_nestedIf10 |
7.61581 us (± 495.551) |
8.02456 us (± 1.15304) |
0.95 |
ir_nestedIf100 |
94.1835 us (± 8.9808) |
87.6189 us (± 6.58879) |
1.07 |
ir_chainedIf10 |
11.8554 us (± 952.387) |
11.6437 us (± 1.02792) |
1.02 |
ir_chainedIf100 |
177.075 us (± 11.9316) |
164.697 us (± 8.40094) |
1.08 |
comp_mlir_add |
5.76926 ms (± 180.597) |
5.52896 ms (± 150.264) |
1.04 |
comp_mlir_ifThenElse |
6.44384 ms (± 173.12) |
6.15129 ms (± 143.859) |
1.05 |
comp_mlir_deeplyNestedIfElse |
5.22158 ms (± 166.686) |
5.04123 ms (± 67.5269) |
1.04 |
comp_mlir_loop |
7.64623 ms (± 238.472) |
7.23834 ms (± 348.192) |
1.06 |
comp_mlir_ifInsideLoop |
30.7053 ms (± 306.018) |
28.78 ms (± 822.48) |
1.07 |
comp_mlir_loopDirectCall |
12.7212 ms (± 194.752) |
12.4205 ms (± 456.737) |
1.02 |
comp_mlir_pointerLoop |
29.7581 ms (± 235.432) |
28.18 ms (± 795.83) |
1.06 |
comp_mlir_staticLoop |
5.21001 ms (± 161.304) |
4.98862 ms (± 45.2884) |
1.04 |
comp_mlir_fibonacci |
11.3199 ms (± 382.641) |
10.5174 ms (± 254.747) |
1.08 |
comp_mlir_gcd |
10.0507 ms (± 182.841) |
9.43739 ms (± 66.7206) |
1.06 |
comp_mlir_nestedIf10 |
11.0321 ms (± 178.735) |
10.9118 ms (± 562.598) |
1.01 |
comp_mlir_nestedIf100 |
26.6508 ms (± 223.876) |
25.5045 ms (± 614.911) |
1.04 |
comp_mlir_chainedIf10 |
10.2957 ms (± 196.313) |
9.77351 ms (± 299.372) |
1.05 |
comp_mlir_chainedIf100 |
22.0684 ms (± 420.053) |
20.2026 ms (± 289.302) |
1.09 |
comp_cpp_add |
26.673 ms (± 363.08) |
25.3523 ms (± 536.121) |
1.05 |
comp_cpp_ifThenElse |
27.1721 ms (± 333.076) |
25.6938 ms (± 472.16) |
1.06 |
comp_cpp_deeplyNestedIfElse |
28.2077 ms (± 383.206) |
26.2772 ms (± 280.811) |
1.07 |
comp_cpp_loop |
27.7801 ms (± 1.30494) |
25.3249 ms (± 302.8) |
1.10 |
comp_cpp_ifInsideLoop |
28.3094 ms (± 407.385) |
26.0316 ms (± 253.783) |
1.09 |
comp_cpp_loopDirectCall |
28.0121 ms (± 398.668) |
25.5171 ms (± 227.43) |
1.10 |
comp_cpp_pointerLoop |
27.9928 ms (± 417.109) |
25.7051 ms (± 267.651) |
1.09 |
comp_cpp_staticLoop |
27.5287 ms (± 1.8044) |
25.1416 ms (± 369.29) |
1.09 |
comp_cpp_fibonacci |
27.665 ms (± 598.846) |
25.9456 ms (± 429.397) |
1.07 |
comp_cpp_gcd |
27.3996 ms (± 355.943) |
25.3955 ms (± 444.048) |
1.08 |
comp_cpp_nestedIf10 |
30.495 ms (± 398.624) |
28.4827 ms (± 851.989) |
1.07 |
comp_cpp_nestedIf100 |
64.3436 ms (± 299.906) |
62.4417 ms (± 958.238) |
1.03 |
comp_cpp_chainedIf10 |
32.7794 ms (± 518.802) |
31.448 ms (± 927.552) |
1.04 |
comp_cpp_chainedIf100 |
94.4447 ms (± 486.894) |
92.2053 ms (± 608.636) |
1.02 |
comp_bc_add |
15.0236 us (± 3.26676) |
14.582 us (± 1.75527) |
1.03 |
comp_bc_ifThenElse |
18.8481 us (± 4.0383) |
18.6811 us (± 3.58857) |
1.01 |
comp_bc_deeplyNestedIfElse |
23.1525 us (± 4.24532) |
22.7163 us (± 4.31134) |
1.02 |
comp_bc_loop |
18.9145 us (± 3.5574) |
18.9731 us (± 4.056) |
1.00 |
comp_bc_ifInsideLoop |
21.8023 us (± 4.33381) |
21.2198 us (± 3.74251) |
1.03 |
comp_bc_loopDirectCall |
20.0216 us (± 4.24685) |
18.9753 us (± 3.3135) |
1.06 |
comp_bc_pointerLoop |
20.4765 us (± 4.01062) |
20.1783 us (± 3.72759) |
1.01 |
comp_bc_staticLoop |
17.4044 us (± 3.89922) |
17.3933 us (± 3.71277) |
1.00 |
comp_bc_fibonacci |
19.2147 us (± 3.64483) |
18.4986 us (± 2.35865) |
1.04 |
comp_bc_gcd |
18.8101 us (± 3.96086) |
17.9795 us (± 2.53701) |
1.05 |
comp_bc_nestedIf10 |
35.9997 us (± 4.9165) |
34.8719 us (± 4.27966) |
1.03 |
comp_bc_nestedIf100 |
206.84 us (± 14.279) |
191.397 us (± 12.8541) |
1.08 |
comp_bc_chainedIf10 |
52.1999 us (± 7.88685) |
49.1121 us (± 5.49462) |
1.06 |
comp_bc_chainedIf100 |
317.156 us (± 28.2785) |
297.447 us (± 12.8065) |
1.07 |
comp_asmjit_add |
21.0366 us (± 4.34934) |
20.7886 us (± 3.14001) |
1.01 |
comp_asmjit_ifThenElse |
34.1709 us (± 5.83829) |
32.8265 us (± 5.22408) |
1.04 |
comp_asmjit_deeplyNestedIfElse |
58.9283 us (± 11.4351) |
56.0766 us (± 9.15709) |
1.05 |
comp_asmjit_loop |
35.8162 us (± 5.4071) |
35.0292 us (± 5.17887) |
1.02 |
comp_asmjit_ifInsideLoop |
57.7865 us (± 10.9293) |
57.2267 us (± 11.6151) |
1.01 |
comp_asmjit_loopDirectCall |
45.981 us (± 9.78858) |
44.056 us (± 5.42689) |
1.04 |
comp_asmjit_pointerLoop |
49.9813 us (± 10.3198) |
48.1419 us (± 8.30256) |
1.04 |
comp_asmjit_staticLoop |
28.208 us (± 5.07038) |
28.3138 us (± 5.3941) |
1.00 |
comp_asmjit_fibonacci |
44.4984 us (± 9.19889) |
43.0434 us (± 8.60098) |
1.03 |
comp_asmjit_gcd |
35.4875 us (± 5.69178) |
35.0731 us (± 6.56689) |
1.01 |
comp_asmjit_nestedIf10 |
105.897 us (± 16.6961) |
104.565 us (± 14.2612) |
1.01 |
comp_asmjit_nestedIf100 |
1061 us (± 22983.6) |
1068.05 us (± 146903) |
0.99 |
comp_asmjit_chainedIf10 |
156.672 us (± 15.929) |
154.231 us (± 15.4403) |
1.02 |
comp_asmjit_chainedIf100 |
2.17614 ms (± 38.2343) |
2.13529 ms (± 28.6135) |
1.02 |
trace_add |
2.37349 us (± 234.58) |
2.49638 us (± 295.356) |
0.95 |
completing_trace_add |
2.3607 us (± 249.052) |
2.4736 us (± 334.61) |
0.95 |
trace_ifThenElse |
8.86378 us (± 1.39171) |
9.30328 us (± 1.67908) |
0.95 |
completing_trace_ifThenElse |
4.82923 us (± 604.592) |
4.70958 us (± 574.319) |
1.03 |
trace_deeplyNestedIfElse |
26.3172 us (± 3.43557) |
26.0099 us (± 3.07346) |
1.01 |
completing_trace_deeplyNestedIfElse |
12.9301 us (± 1.79449) |
13.1091 us (± 1.70257) |
0.99 |
trace_loop |
8.7599 us (± 1.34517) |
8.71348 us (± 1.22788) |
1.01 |
completing_trace_loop |
4.79224 us (± 817.023) |
4.77327 us (± 516.624) |
1.00 |
trace_ifInsideLoop |
17.3198 us (± 3.2312) |
17.3334 us (± 2.90873) |
1.00 |
completing_trace_ifInsideLoop |
8.6127 us (± 1.20605) |
8.82408 us (± 1.28846) |
0.98 |
trace_loopDirectCall |
8.90479 us (± 1.37376) |
8.96005 us (± 1.49533) |
0.99 |
completing_trace_loopDirectCall |
5.07225 us (± 835.684) |
5.1524 us (± 762.558) |
0.98 |
trace_pointerLoop |
14.8193 us (± 2.90513) |
14.2471 us (± 2.16149) |
1.04 |
completing_trace_pointerLoop |
10.4943 us (± 2.15664) |
10.4746 us (± 1.84546) |
1.00 |
trace_staticLoop |
7.60037 us (± 942.208) |
7.6142 us (± 1.0114) |
1.00 |
completing_trace_staticLoop |
7.47457 us (± 784.203) |
7.46691 us (± 872.687) |
1.00 |
trace_fibonacci |
10.4244 us (± 1.88527) |
10.1531 us (± 1.57566) |
1.03 |
completing_trace_fibonacci |
6.13778 us (± 865.134) |
6.17947 us (± 858.737) |
0.99 |
trace_gcd |
7.93086 us (± 1.13898) |
8.05058 us (± 1.02295) |
0.99 |
completing_trace_gcd |
4.02168 us (± 504.098) |
4.06246 us (± 448.501) |
0.99 |
trace_nestedIf10 |
39.3569 us (± 7.99365) |
37.7878 us (± 6.23274) |
1.04 |
completing_trace_nestedIf10 |
39.379 us (± 7.13475) |
38.9354 us (± 7.34432) |
1.01 |
trace_nestedIf100 |
1.38147 ms (± 64.483) |
1.34644 ms (± 53.7282) |
1.03 |
completing_trace_nestedIf100 |
1.37537 ms (± 45.3519) |
1.35177 ms (± 56.6128) |
1.02 |
trace_chainedIf10 |
99.1633 us (± 10.3264) |
99.7738 us (± 12.6143) |
0.99 |
completing_trace_chainedIf10 |
51.4546 us (± 9.21541) |
49.9159 us (± 9.0803) |
1.03 |
trace_chainedIf100 |
4.46327 ms (± 60.7566) |
4.48434 ms (± 79.2886) |
1.00 |
completing_trace_chainedIf100 |
2.37464 ms (± 360.701) |
2.26925 ms (± 73.0211) |
1.05 |
This comment was automatically generated by workflow using github-action-benchmark.
Create Interface/IntegerTypeTest.cpp and Interface/FloatTypeTest.cpp, which test all integer (int8_t–uint64_t) and floating-point (float, double) val<T> operations through the Nautilus engine — covering arithmetic, comparison, bitwise, and special float values — across the interpreter and all compiled backends. Update val-tests/CMakeLists.txt to enable the previously commented-out files and add the common test include directory so ExecutionTest.hpp utilities are accessible. https://claude.ai/code/session_01T4LctiVoSm51mtPMfqUcgT
PhilippGrulich
force-pushed
the
claude/enable-numeric-type-tests-I8lCB
branch
from
a9baff3 to
e6859de
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Create Interface/IntegerTypeTest.cpp and Interface/FloatTypeTest.cpp,
which test all integer (int8_t–uint64_t) and floating-point (float,
double) val operations through the Nautilus engine — covering
arithmetic, comparison, bitwise, and special float values — across
the interpreter and all compiled backends.
Update val-tests/CMakeLists.txt to enable the previously commented-out
files and add the common test include directory so ExecutionTest.hpp
utilities are accessible.
https://claude.ai/code/session_01T4LctiVoSm51mtPMfqUcgT