Tokenizer v0.2.8
·
658 commits
to refs/heads/main
since this release
Changes
- Changes related to the rebranding (#66)
- Update LICENSE (#67) @curquiza
- Small fix in
benches/(#71) @Thearas - Setup lindera tokenizer for ja support ( related with #49 ) (#70) @miiton
- Benchmark and optimize japanese (#73) @ManyTheFish
- Decompose Japanese compound words (#75) @mosuka
- Update the dependencies (#80) @Kerollmops
Thanks again to @Kerollmops, @ManyTheFish, @Thearas, @curquiza, @miiton and @mosuka! 🎉
Contributors
miiton, mosuka, and 4 other contributors