dmatth1 / REPOSITORY

quicktok

Quicktok, an exact BPE tokenizer 7x faster than tiktoken

AI & agentsShow HNLicense unchecked
Explore repositoryOriginal HN title; author claims are not independently verified.
1Top HN score
1Total comments
1Linked discussions

What the community said