text
mlx port of karpathy’s minbpe 🤕
mlx port of karpathy’s minbpe 🤕
new_line
text
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
new_line
text
Code: 
Code: 
link
https://github.com/Jaykef/mlx-minbpe
https://github.com/Jaykef/mlx-minbpe
mlx port of karpathy’s minbpe 🤕
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
Code: https://github.com/Jaykef/mlx-minbpe
🔥
radames osanseviero roseopal