๐ Scaling Laws with Vocabulary
Collection
Increase your vocabulary size when you scale up your language model
โข
5 items
โข
Updated
โข
6
The trained BPE tokenziers with various vocabulary sizes, which uses to study how the vocabulary size affects the performance of language models.