Tokenizer v0.2.1

meili-bot released this 14 Apr 16:51

· 732 commits to main since this release

b7a89c6

Changes

Add release drafter files (#37) @curquiza
Add bors (#41) @curquiza
Fix separators: treat cyrillic chars as non-separators (#39) @shekhirin

Thanks again to @shekhirin! 🎉

Assets 2