Skip to content

Pull requests: zurawiki/tiktoken-rs

New pull request New
10 Open 95 Closed
10 Open 95 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add parallel encoding for large texts
#136 opened Jan 23, 2026 by OtsoBear Loading…
1
Add count-only token counting + fast o200k_base ASCII path
#135 opened Jan 15, 2026 by n-WN Loading…
1
chore(deps): update actions/checkout action to v6
#134 opened Jan 1, 2026 by renovate bot Loading…
1 task
fix(deps): update rust crate fancy-regex to 0.17.0
#133 opened Jan 1, 2026 by renovate bot Loading…
1 task
fix(deps): update rust crate async-openai to 0.33.0
#132 opened Jan 1, 2026 by renovate bot Loading…
1 task
chore(deps): update swatinem/rust-cache digest to 779680d
#131 opened Jan 1, 2026 by renovate bot Loading…
1 task
chore(deps): update actions/checkout digest to 93cb6ef
#130 opened Jan 1, 2026 by renovate bot Loading…
1 task
deps: bump rustc-hash, async-openai and fancy-regex
#129 opened Dec 13, 2025 by omarkilani Loading…
Add tiktoken CLI 🚀
#115 opened Aug 7, 2025 by kyle-rader Loading…
api: Use bpe singleton for num_tokens_from_messages
#114 opened Aug 7, 2025 by smitbarmase Loading…
ProTip! Adding no:label will show everything without a label.