safetensors region:us
## Model Details

The model is a finetuned version of Mistral 7B, tuned on a small subset of the [MathInstruct database by TIGER-Lab](https://tiger-ai-lab.github.io/MAmmoTH/).

This finetuning was done to see whether an incredibly small subset, roughly 5000 data points, could cause a noticeable increase in the mathematical performance of the model as well as allow me to experiment with hosting and running LLMs locally.

The framework employed for finetuning was PEFT LoRA or Low-Rank Adaptation.

More about the training process and some example results can be seen on my [GitHub repo](https://github.com/akashvshroff/MathGPT).

Framework versions
PEFT 0.7.1