
Trained on 3 epoch of the EverythingLM data.

Eval Results : 

![image/png](https://huggingface.co/aloobun/open-llama-3b-v2-elmv3/resolve/main/assets/lm-eval.png)

I like to tweak smaller models than 3B and mix loras, but now I'm trying my hand at finetuning a 3B model. Lets see how it goes.
{"language": ["en"], "license": "apache-2.0", "tags": ["openllama", "3b"], "datasets": ["totally-not-an-llm/EverythingLM-data-V3"]}
transformers safetensors llama text-generation openllama 3b en dataset:totally-not-an-llm/EverythingLM-data-V3 license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us