license:mit region:us
---
license: mit
---
Quantiazied tinyllama model (stories15m.pt). See original repo: https://github.com/karpathy/llama2.c
See how to quantize here: https://github.com/ademyanchuk/llama2.c/blob/master/export.py#L282C14-L282C14
Use version 3 of export on stories15m.pt model. 

Use the model in this rust port of llama2.c project: https://github.com/ademyanchuk/llama2-rs