Skip to content

Add clang-22 to CI matrix, drop clang-19#336

Open
PhilippGrulich wants to merge 3 commits into
mainfrom
claude/clang-22-ci-matrix-ji26xc
Open

Add clang-22 to CI matrix, drop clang-19#336
PhilippGrulich wants to merge 3 commits into
mainfrom
claude/clang-22-ci-matrix-ji26xc

Conversation

@PhilippGrulich

Copy link
Copy Markdown
Member

Summary

  • Replace the clang-19 entry in the build-test matrix (.github/workflows/pr.yml) with clang-22, keeping the matrix's "two-versions-apart" coverage window (previously 19/21, now 21/22) around the clang-21 default declared in CLAUDE.md.
  • Update the test inlining plugin step's version guard from clang-19 || clang-20 || clang-21 to clang-20 || clang-21 || clang-22 so it still runs for the newly added compiler.

Test plan

  • CI build-test matrix passes for the new clang-22 entry
  • test inlining plugin step runs and passes under clang-22

Generated by Claude Code

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tracing Benchmark

Details
Benchmark suite Current: efc7888 Previous: 14b8779 Ratio
exec_bc_addOne 76.3645 ns (± 16.0124) 41.3245 ns (± 7.4719) 1.85
exec_mlir_addOne 314.409 ns (± 10.0088) 288.312 ns (± 5.71107) 1.09
exec_cpp_addOne 4.12526 ns (± 0.465315) 3.94593 ns (± 0.530753) 1.05
exec_interpreted_addOne 40.9192 ns (± 2.16547) 39.5856 ns (± 1.98647) 1.03
tiered_twotier_addOne 3.75711 ms (± 104.22) 3.37833 ms (± 49.851) 1.11
tiered_singletier_addOne 3.65468 ms (± 460.012) 3.28493 ms (± 45.8553) 1.11
single_compile_mlir_addOne 3.62372 ms (± 105.874) 3.28697 ms (± 79.5036) 1.10
single_compile_cpp_addOne 28.8725 ms (± 710.136)
single_compile_bc_addOne 59.8741 us (± 17.4931)
tiered_twotier_sumLoop 5.92184 ms (± 173.816)
tiered_singletier_sumLoop 5.75784 ms (± 167.671)
single_compile_mlir_sumLoop 5.74283 ms (± 134.518)
single_compile_cpp_sumLoop 29.5511 ms (± 1.72242)
single_compile_bc_sumLoop 113.653 us (± 20.5948)
ssa_add 207.457 ns (± 21.7935) 189.683 ns (± 22.1435) 1.09
ssa_ifThenElse 451.534 ns (± 28.1664) 447.09 ns (± 56.4127) 1.01
ssa_deeplyNestedIfElse 1.05597 us (± 61.805) 1.10698 us (± 76.8539) 0.95
ssa_loop 562.239 ns (± 131.354) 473.148 ns (± 28.5543) 1.19
ssa_ifInsideLoop 900.831 ns (± 162.425) 852.487 ns (± 58.293) 1.06
ssa_loopDirectCall 493.593 ns (± 29.272) 497.983 ns (± 61.104) 0.99
ssa_pointerLoop 584.831 ns (± 31.8342) 574.984 ns (± 46.7359) 1.02
ssa_staticLoop 424.003 ns (± 22.3677) 418.539 ns (± 41.9918) 1.01
ssa_fibonacci 500.54 ns (± 30.2646) 495.628 ns (± 41.0553) 1.01
ssa_gcd 404.234 ns (± 26.5303) 459.397 ns (± 70.174) 0.88
e2e_tiered_bc_to_mlir 3767.0699999999997 us (± 106711) 3455.64 us (± 93007.5) 1.09
e2e_single_mlir 6.33515 ms (± 284.258) 5.69342 ms (± 374.152) 1.11
trace_add 2.26629 us (± 187.566) 2.3397 us (± 311.307) 0.97
completing_trace_add 2.27249 us (± 201.198) 2.63287 us (± 778.411) 0.86
trace_ifThenElse 8.15127 us (± 1.31391) 8.8132 us (± 1.23382) 0.92
completing_trace_ifThenElse 4.49687 us (± 477.36) 4.57547 us (± 490.909) 0.98
trace_deeplyNestedIfElse 24.8958 us (± 3.37688) 26.0124 us (± 2.80491) 0.96
completing_trace_deeplyNestedIfElse 12.6183 us (± 1.79834) 12.8904 us (± 1.78046) 0.98
trace_loop 8.16602 us (± 1.52257) 8.66303 us (± 1.18416) 0.94
completing_trace_loop 4.60829 us (± 547.322) 4.70593 us (± 577.807) 0.98
trace_ifInsideLoop 16.174 us (± 3.74243) 16.8575 us (± 2.71583) 0.96
completing_trace_ifInsideLoop 8.27432 us (± 1.12832) 8.46942 us (± 989.557) 0.98
trace_loopDirectCall 8.28213 us (± 1.52401) 8.8304 us (± 1.28981) 0.94
completing_trace_loopDirectCall 4.69188 us (± 577.258) 4.8357 us (± 485.561) 0.97
trace_pointerLoop 13.559 us (± 2.46946) 14.1048 us (± 2.78449) 0.96
completing_trace_pointerLoop 10.0388 us (± 1.54822) 10.3108 us (± 1.51915) 0.97
trace_staticLoop 7.50713 us (± 750.914) 7.46717 us (± 854.023) 1.01
completing_trace_staticLoop 7.48341 us (± 734.903) 7.56039 us (± 754.296) 0.99
trace_fibonacci 9.54193 us (± 1.43824) 10.0794 us (± 1.66522) 0.95
completing_trace_fibonacci 5.94621 us (± 695.813) 6.11087 us (± 724.107) 0.97
trace_gcd 7.43814 us (± 1.11555) 7.94831 us (± 1.13354) 0.94
completing_trace_gcd 3.792 us (± 388.133) 4.08816 us (± 510.52) 0.93
trace_nestedIf10 38.9796 us (± 7.97352) 37.9786 us (± 7.23566) 1.03
completing_trace_nestedIf10 38.3138 us (± 7.20781) 38.1445 us (± 5.94377) 1.00
trace_nestedIf100 1.45297 ms (± 35.0987) 1.35173 ms (± 38.332) 1.07
completing_trace_nestedIf100 1.47439 ms (± 113.64) 1.36772 ms (± 48.8988) 1.08
trace_chainedIf10 95.3423 us (± 11.6688) 98.0727 us (± 8.94107) 0.97
completing_trace_chainedIf10 49.1861 us (± 9.13574) 48.9055 us (± 7.05805) 1.01
trace_chainedIf100 4.37197 ms (± 128.922) 4.41664 ms (± 40.9728) 0.99
completing_trace_chainedIf100 2.23815 ms (± 38.1826) 2.3069 ms (± 38.0332) 0.97
comp_mlir_add 6.50631 ms (± 346.959) 5.59745 ms (± 75.8607) 1.16
comp_mlir_ifThenElse 7.21823 ms (± 312.431) 6.18086 ms (± 70.1066) 1.17
comp_mlir_deeplyNestedIfElse 5.78078 ms (± 198.53) 5.10257 ms (± 71.2786) 1.13
comp_mlir_loop 8.23214 ms (± 321.923) 7.26388 ms (± 66.5618) 1.13
comp_mlir_ifInsideLoop 30.9475 ms (± 444.13) 29.2998 ms (± 1.93843) 1.06
comp_mlir_loopDirectCall 13.3194 ms (± 347.631) 12.0253 ms (± 589.45) 1.11
comp_mlir_pointerLoop 29.7684 ms (± 270.914) 28.0524 ms (± 211.875) 1.06
comp_mlir_staticLoop 6.11373 ms (± 1.1913) 5.0497 ms (± 73.1474) 1.21
comp_mlir_fibonacci 12.0248 ms (± 345.789) 10.5517 ms (± 106.49) 1.14
comp_mlir_gcd 10.4749 ms (± 359.625) 9.52985 ms (± 100.353) 1.10
comp_mlir_nestedIf10 11.5937 ms (± 363.358) 10.6082 ms (± 117.17) 1.09
comp_mlir_nestedIf100 26.369 ms (± 478.968) 25.217 ms (± 197.247) 1.05
comp_mlir_chainedIf10 10.7946 ms (± 270.883) 9.84473 ms (± 225.364) 1.10
comp_mlir_chainedIf100 22.6624 ms (± 172.176) 20.7803 ms (± 335.166) 1.09
comp_cpp_add 28.9725 ms (± 689.169) 25.6772 ms (± 412.173) 1.13
comp_cpp_ifThenElse 29.476 ms (± 815.915) 26.3495 ms (± 501.785) 1.12
comp_cpp_deeplyNestedIfElse 30.5199 ms (± 468.812) 27.8964 ms (± 2.25797) 1.09
comp_cpp_loop 29.4056 ms (± 452.692) 26.4103 ms (± 2.09075) 1.11
comp_cpp_ifInsideLoop 30.6312 ms (± 740.17) 27.4066 ms (± 679.553) 1.12
comp_cpp_loopDirectCall 29.6832 ms (± 465.588) 26.227 ms (± 807.182) 1.13
comp_cpp_pointerLoop 29.931 ms (± 387.928) 26.6674 ms (± 888.775) 1.12
comp_cpp_staticLoop 29.3043 ms (± 471.472) 25.8375 ms (± 792.768) 1.13
comp_cpp_fibonacci 29.5648 ms (± 537.908) 26.3315 ms (± 1.74097) 1.12
comp_cpp_gcd 29.6336 ms (± 668.468) 25.6174 ms (± 829.412) 1.16
comp_cpp_nestedIf10 32.3379 ms (± 720.811) 28.7075 ms (± 879.439) 1.13
comp_cpp_nestedIf100 66.7453 ms (± 3.24348) 62.3274 ms (± 891.694) 1.07
comp_cpp_chainedIf10 34.951 ms (± 800.459) 31.0567 ms (± 839.436) 1.13
comp_cpp_chainedIf100 96.2336 ms (± 1.47403) 91.663 ms (± 1.15819) 1.05
comp_bc_add 14.807 us (± 2.84996) 15.3679 us (± 2.1698) 0.96
comp_bc_ifThenElse 17.4389 us (± 3.70076) 20.4755 us (± 3.35036) 0.85
comp_bc_deeplyNestedIfElse 21.6497 us (± 3.87093) 25.7216 us (± 3.94249) 0.84
comp_bc_loop 17.8284 us (± 3.94931) 20.3691 us (± 2.66709) 0.88
comp_bc_ifInsideLoop 21.0392 us (± 4.456) 23.9821 us (± 3.34349) 0.88
comp_bc_loopDirectCall 18.0184 us (± 3.97972) 21.4873 us (± 3.91159) 0.84
comp_bc_pointerLoop 18.9763 us (± 3.91764) 23.6934 us (± 5.90259) 0.80
comp_bc_staticLoop 17.508 us (± 3.96792) 18.7222 us (± 3.85038) 0.94
comp_bc_fibonacci 18.0047 us (± 3.78185) 20.9393 us (± 3.34641) 0.86
comp_bc_gcd 17.2589 us (± 3.88362) 20.0257 us (± 3.28267) 0.86
comp_bc_nestedIf10 39.8242 us (± 8.93937) 48.8948 us (± 6.12696) 0.81
comp_bc_nestedIf100 271.509 us (± 12.0737) 290.023 us (± 24.7282) 0.94
comp_bc_chainedIf10 53.1556 us (± 8.93125) 65.2141 us (± 8.75591) 0.82
comp_bc_chainedIf100 447.892 us (± 34.32) 495.08 us (± 17.7343) 0.90
comp_tbc_add 1.76632 us (± 146.61) 1.97013 us (± 191.615) 0.90
comp_tbc_ifThenElse 4.02913 us (± 368.147) 4.33227 us (± 640.943) 0.93
comp_tbc_deeplyNestedIfElse 8.76413 us (± 1.04714) 9.92629 us (± 1.27012) 0.88
comp_tbc_loop 4.04946 us (± 363.951) 4.36166 us (± 514.496) 0.93
comp_tbc_ifInsideLoop 6.61938 us (± 716.917) 7.48818 us (± 782.8) 0.88
comp_tbc_loopDirectCall 4.15056 us (± 531.615) 4.67684 us (± 503.618) 0.89
comp_tbc_pointerLoop 5.05206 us (± 542.95) 5.65328 us (± 519.113) 0.89
comp_tbc_staticLoop 4.29577 us (± 393.878) 4.85142 us (± 409.04) 0.89
comp_tbc_fibonacci 4.19881 us (± 427.2) 4.82478 us (± 633.347) 0.87
comp_tbc_gcd 3.66162 us (± 335.202) 3.98474 us (± 628.041) 0.92
comp_tbc_nestedIf10 24.5035 us (± 2.78227) 27.5076 us (± 3.073) 0.89
comp_tbc_nestedIf100 267.731 us (± 8.00523) 285.618 us (± 8.92333) 0.94
comp_tbc_chainedIf10 31.5537 us (± 3.60196) 35.1404 us (± 3.57823) 0.90
comp_tbc_chainedIf100 386.86 us (± 8.74517) 417.843 us (± 23.2181) 0.93
comp_asmjit_add 18.7816 us (± 6.18055) 24.2717 us (± 3.3439) 0.77
comp_asmjit_ifThenElse 24.9909 us (± 5.48578) 32.2864 us (± 3.84337) 0.77
comp_asmjit_deeplyNestedIfElse 34.8381 us (± 5.81311) 50.0224 us (± 10.128) 0.70
comp_asmjit_loop 25.1033 us (± 5.78961) 32.6945 us (± 4.74709) 0.77
comp_asmjit_ifInsideLoop 33.7226 us (± 6.35218) 48.8415 us (± 11.603) 0.69
comp_asmjit_loopDirectCall 28.2185 us (± 7.81918) 42.9908 us (± 8.25887) 0.66
comp_asmjit_pointerLoop 29.8367 us (± 5.96584) 46.3782 us (± 9.51436) 0.64
comp_asmjit_staticLoop 23.649 us (± 5.25272) 29.7142 us (± 4.42358) 0.80
comp_asmjit_fibonacci 26.7799 us (± 5.92414) 33.6551 us (± 3.9617) 0.80
comp_asmjit_gcd 26.0271 us (± 5.98466) 33.2792 us (± 5.05442) 0.78
comp_asmjit_nestedIf10 66.9398 us (± 10.4346) 78.0079 us (± 9.80308) 0.86
comp_asmjit_nestedIf100 494.024 us (± 18.4721) 492.899 us (± 18.5419) 1.00
comp_asmjit_chainedIf10 88.4605 us (± 11.9291) 93.4777 us (± 11.4237) 0.95
comp_asmjit_chainedIf100 655.036 us (± 27.2943) 634.361 us (± 22.461) 1.03
exec_mlir_add 10.3555 ns (± 0.755773) 10.5569 ns (± 0.957746) 0.98
exec_mlir_fibonacci 15.8263 us (± 1.59786) 13.5513 us (± 1.52069) 1.17
exec_mlir_sum 566.84 us (± 61.7415) 543.179 us (± 34.6101) 1.04
exec_cpp_add 4.53025 ns (± 0.512924) 4.76172 ns (± 0.910991) 0.95
exec_cpp_fibonacci 54.5123 us (± 4.06496) 48.0034 us (± 4.29059) 1.14
exec_cpp_sum 12.4299 ms (± 49.0674) 11.4073 ms (± 68.9284) 1.09
exec_bc_add 46.832 ns (± 6.20466) 53.6233 ns (± 2.39616) 0.87
exec_bc_fibonacci 397.186 us (± 13.088) 431.15 us (± 11.3551) 0.92
exec_bc_sum 93.7421 ms (± 5.04351) 94.7658 ms (± 2.62637) 0.99
exec_tbc_add 30.3039 ns (± 2.17036) 26.6071 ns (± 3.02734) 1.14
exec_tbc_fibonacci 150.741 us (± 3.50506) 140.487 us (± 5.7542) 1.07
exec_tbc_sum 40.4008 ms (± 943.384) 36.2511 ms (± 159.003) 1.11
exec_asmjit_add 3.55056 ns (± 0.268287) 3.56801 ns (± 0.662199) 1.00
exec_asmjit_fibonacci 18.8387 us (± 1.8701) 14.7187 us (± 2.42364) 1.28
exec_asmjit_sum 3.36392 ms (± 39.0738) 2.80822 ms (± 51.931) 1.20
exec_bc_add_passesOff 46.419 ns (± 3.8729) 53.3981 ns (± 0.886462) 0.87
exec_bc_add_passesOn 46.312 ns (± 2.75026) 55.0367 ns (± 7.32706) 0.84
exec_bc_fibonacci_passesOff 396.014 us (± 12.6092) 431.164 us (± 11.6266) 0.92
exec_bc_fibonacci_passesOn 383.181 us (± 17.4994) 389.038 us (± 13.2051) 0.98
exec_bc_sum_passesOff 93.9707 ms (± 2.52175) 94.6557 ms (± 2.21379) 0.99
exec_bc_sum_passesOn 81.9101 ms (± 428.201) 79.0462 ms (± 2.06405) 1.04
exec_tbc_add_passesOff 31.8178 ns (± 3.1245) 26.735 ns (± 3.06805) 1.19
exec_tbc_add_passesOn 31.9279 ns (± 3.46563) 26.0811 ns (± 2.41377) 1.22
exec_tbc_fibonacci_passesOff 153.762 us (± 5.7658) 141.757 us (± 7.00518) 1.08
exec_tbc_fibonacci_passesOn 152.655 us (± 4.82378) 142.653 us (± 7.73334) 1.07
exec_tbc_sum_passesOff 40.0203 ms (± 77.213) 36.2128 ms (± 50.656) 1.11
exec_tbc_sum_passesOn 37.9001 ms (± 51.9038) 33.9606 ms (± 81.7397) 1.12
exec_asmjit_add_passesOff 3.601 ns (± 0.432231) 3.53616 ns (± 0.444475) 1.02
exec_asmjit_add_passesOn 3.55438 ns (± 0.272935) 3.52063 ns (± 0.409302) 1.01
exec_asmjit_fibonacci_passesOff 19.0586 us (± 2.48821) 14.1953 us (± 1.14959) 1.34
exec_asmjit_fibonacci_passesOn 19.4725 us (± 3.73713) 14.4526 us (± 2.03601) 1.35
exec_asmjit_sum_passesOff 3.37843 ms (± 66.9833) 2.79544 ms (± 22.6922) 1.21
exec_asmjit_sum_passesOn 3.37597 ms (± 53.2566) 2.83247 ms (± 281.496) 1.19
exec_bc_add_noRegAlloc 48.6474 ns (± 9.17401) 53.7209 ns (± 3.31915) 0.91
exec_bc_add_regAlloc 45.9705 ns (± 2.52388) 53.6882 ns (± 4.63621) 0.86
exec_bc_fibonacci_noRegAlloc 411.427 us (± 24.5882) 430.284 us (± 10.0406) 0.96
exec_bc_fibonacci_regAlloc 394.671 us (± 10.7065) 432.27 us (± 13.5598) 0.91
exec_bc_sum_noRegAlloc 213.96 ms (± 764.423) 94.7041 ms (± 3.50961) 2.26
exec_bc_sum_regAlloc 93.3966 ms (± 1.3579) 93.7558 ms (± 2.68879) 1.00
exec_bc_add_call 46.1706 ns (± 3.97267) 53.9547 ns (± 5.69584) 0.86
exec_bc_add_switch 41.4212 ns (± 4.34854) 41.5811 ns (± 4.52889) 1.00
exec_bc_add_threaded 39.5101 ns (± 5.24018) 39.7723 ns (± 5.7715) 0.99
exec_bc_fibonacci_call 397.043 us (± 15.6129) 434.049 us (± 18.7702) 0.91
exec_bc_fibonacci_switch 322.916 us (± 14.608) 332.317 us (± 11.0427) 0.97
exec_bc_fibonacci_threaded 471.509 us (± 11.1404) 436.228 us (± 14.7313) 1.08
exec_bc_sum_call 93.2275 ms (± 311.543) 93.964 ms (± 2.81663) 0.99
exec_bc_sum_switch 70.142 ms (± 2.10246) 69.8854 ms (± 3.12756) 1.00
exec_bc_sum_threaded 96.2048 ms (± 1.8691) 86.725 ms (± 1.37075) 1.11
exec_bc_add_threaded_noReuse 39.1146 ns (± 1.99489) 39.3616 ns (± 5.42663) 0.99
exec_bc_add_threaded_reuse 35.8244 ns (± 2.13689) 34.6287 ns (± 2.89211) 1.03
exec_bc_fibonacci_threaded_noReuse 469.243 us (± 8.93043) 435.438 us (± 11.9375) 1.08
exec_bc_fibonacci_threaded_reuse 474.485 us (± 12.837) 434.497 us (± 10.2818) 1.09
exec_bc_sum_threaded_noReuse 96.2493 ms (± 2.217) 86.4488 ms (± 590) 1.11
exec_bc_sum_threaded_reuse 95.7462 ms (± 629.987) 86.8712 ms (± 3.47558) 1.10
exec_bc_add_threaded_noSuperinstr 39.1964 ns (± 3.51857) 39.0278 ns (± 3.68365) 1.00
exec_bc_add_threaded_superinstr 39.6605 ns (± 4.02994) 39.548 ns (± 6.27968) 1.00
ir_add 708.971 ns (± 46.4323) 798.667 ns (± 76.1341) 0.89
ir_ifThenElse 1.51174 us (± 114.59) 1.56928 us (± 133.239) 0.96
ir_deeplyNestedIfElse 3.34211 us (± 298.583) 3.36304 us (± 235.3) 0.99
ir_loop 1.58359 us (± 101.202) 1.62131 us (± 182.006) 0.98
ir_ifInsideLoop 2.98941 us (± 581.591) 2.87574 us (± 279.797) 1.04
ir_loopDirectCall 1.77481 us (± 211.622) 1.80265 us (± 308.099) 0.98
ir_pointerLoop 1.9238 us (± 120.841) 2.06626 us (± 227.803) 0.93
ir_staticLoop 1.41505 us (± 101.598) 1.46245 us (± 167.987) 0.97
ir_fibonacci 1.68203 us (± 121.353) 1.74367 us (± 138.248) 0.96
ir_gcd 1.42371 us (± 94.4181) 1.49687 us (± 142.622) 0.95
ir_nestedIf10 7.73549 us (± 401.31) 7.76069 us (± 553.136) 1.00
ir_nestedIf100 88.5535 us (± 2.84022) 91.7975 us (± 4.46084) 0.96
ir_chainedIf10 11.7757 us (± 751.792) 12.0102 us (± 1.09688) 0.98
ir_chainedIf100 162.664 us (± 6.07767) 174.577 us (± 8.80268) 0.93

This comment was automatically generated by workflow using github-action-benchmark.

@PhilippGrulich
PhilippGrulich marked this pull request as ready for review July 3, 2026 05:39
claude added 3 commits July 9, 2026 07:42
clang-19 was the oldest compiler tested; clang-22 keeps the matrix's
two-versions-apart coverage window alongside the clang-21 default.
Fixes clang-22 CI failures: __COUNTER__ (used internally by SECTION)
was promoted to a C2y extension in clang 22 and rejected under
-pedantic-errors. Catch2 3.14.0 added a suppression for this.
Lost during the raw-content download used to bump Catch2 to 3.15.1.
@PhilippGrulich
PhilippGrulich force-pushed the claude/clang-22-ci-matrix-ji26xc branch from 15a08d2 to efc7888 Compare July 9, 2026 05:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants