This is a frankensteined Marx3b-v2 model (https://huggingface.co/acrastt/Marx-3B-V2)

It is approximately 7.1b. Just testing things out.

bfloat16

Used the same model 4 times. I fine-tuned it at r 256 but used the wrong alpaca format so I'll need to re-upload that merged model.
{"license": "mit"}
transformers safetensors llama text-generation license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us