chore: Updates tree-sitter version

[kritzcreek]

Schritt-Atemzug-Besenstrich
— Beppo

Common changes

Most of the highlighting queries needed to be adjusted, because in 0.21 tree-sitter-highlight switched to a "last-match-wins" strategy for dealing with overlapping captures. This mostly means that "catch all" rules like (identifier) @variable now need to move to the top of the query, but there are a few other cases with overlaps which I flipped around until all the snapshots passed again.

In some places the upstream grammar renamed/removed/wrapped nodes, which meant I needed to make small adjustments to the queries. Where appropriate I tried to follow the upstream queries, and otherwise just made sure to keep the snapshots correct.

Language specific changes

JS/TS snapshot diffs are caused by a refactoring of both JSX tag handling and strings. The queries now cause a few more separate overlapping matches for strings which is noisy in the snapshot output but shouldn't change the highlighting as the same ranges are still marked as "string".

I added a file to test jsonnnet highlighting as we didn't have one in the repo yet.

The C# grammar was completely rewritten in tree-sitter/tree-sitter-c-sharp#333, and it produces error nodes on a file we checked in to guard against a syntect loop at some point. I don't know enough about C# to really have a good grasp on what's the best thing to do here. The highlighting diff looks reasonable for the file we checked in for highlight testing.
I discussed this with Matt and we agreed that I'd fork pre-grammar-rewrite and bump its tree-sitter version. I've also gone ahead and reported the errors we found upstream.

The Nickel snapshot changes are caused by updating the highlights.scm file. From what I can tell we were previously using a copy of the upstream queries, and so I also updated our copy. This highlighting ranges are very different, but they seem more detailed and correct at a glance.

The Python snapshot changes are a bug-fix.

The Rust snapshot changes are partially bugfix/partially improved parsing for attribute macros from upstream.

I swapped our SQL grammar as the one we were using wasn't maintained for a while. From what I can tell the new grammar is maintained nicely and well structured.

I pointed at tree-sitter-pkl for my personal fork, but didn't upstream a PR because there is a much more comprehensive PR there already. My fork just contains the minimal change to bump the TS version. We could either fork to sourcegraph/tree-sitter-pkl or maybe we know someone to ping to take a look at the upstream PR?

Deleted any reference to xlsg, as apparently it was a made up joke language?

Bazel/Build specific

Unfortunately the released 0.22.6 version of tree-sitter (from May) doesn't build under Bazel. We need the fix from tree-sitter/tree-sitter#3352, so I've used a Cargo feature to make sure we're using that patched tree-sitter for our build. I'm not sure why it has been such a long time since TS put out a release but we can get rid of that override with the next release.

TODO:

• fix globals regression for Zig
• talk about changes in C# snapshots with our resident Microsoft Apostle
• Get the different open PRs merged and change Cargo.toml refs to upstream where appropriate
  • Dart Updates for tree-sitter 0.22.6 UserNobody14/tree-sitter-dart#74
  • Jsonnet updates for tree-sitter 0.22.6 tree-sitter-jsonnet#22
  • Magik updates for tree-sitter 0.22.6 tree-sitter-magik#1 (Not mergeable as is because the PR branch is missing a bunch of commits from main that we no longer need). Maybe we should rebase main on the fork to get closer to upstream again @mmanela?
  • Matlab Updates Cargo tree-sitter dependency acristoffers/tree-sitter-matlab#14
  • Nickel Bumps tree-sitter version nickel-lang/tree-sitter-nickel#52
  • Hack Updates for tree-sitter 0.22 slackhq/tree-sitter-hack#73
  • Perl Updates for tree-sitter 0.22.6 tree-sitter-perl#5
  • Pod Updates for tree-sitter 0.22.6 tree-sitter-pod#1
• Building with Bazel requires tree-sitter/tree-sitter@d35e401, which isn't in a released version. I fixed this by using the "patch" section in the Cargo.toml file, but if there's a better way to patch this with Bazel I'm open for suggestions.

Test plan

Updated snapshots, things continue to compile