Tags = [ #rust ]
-
Fast byte pair encoding in rust
An O(log n) optimization I found to speed up tokenizer throughput
Posted on 2024-05-10
read more
an ml/backend devlog
An O(log n) optimization I found to speed up tokenizer throughput
Posted on 2024-05-10
read more