Skip to content

Tokenizer v0.2.7

Compare
Choose a tag to compare
@meili-bot meili-bot released this 10 Jan 18:45
· 693 commits to main since this release

Changes

  • Count chars instead of graphemes and fix return value when char_map is uninitialized (#64) @Samyak2

Thanks again to @Samyak2 ! 🎉