transformers llama text-generation generated_from_trainer lora autotrain_compatible endpoints_compatible text-generation-inference 4-bit bitsandbytes region:us
---
tags:
- generated_from_trainer
- lora
model-index:
- name: qlora-yi-34b-200k-aezakmi-v2-run2
  results: []
---

This is a test run. I trained it just to see whether it was possible to train 34B 200K ctx Yi on 24GB card and for it to work fine after exl2 quant. \
I actually really like the vocabulary that this lora has. It spits out a bit of chinese due to light English training, but for the most part it gives pretty natural outputs.