
NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers.

This is a GPTQ 4 bit quant of ChanSung's Elina 33b.
This is a LlaMa based model; LoRA merged with latest transformers conversion.
Quantized with GPTQ, --wbits 4 --act-order --true-sequential --save_safetensors c4.

128 groupsize was not used so those running this on a consumer GPU with 24GB VRAM can run it at full
context (2048) without any risk of OOM.


Original LoRA:
https://huggingface.co/LLMs/Alpaca-LoRA-30B-elina


Repo:
https://huggingface.co/LLMs


Likely Author:
https://huggingface.co/chansung
{"license": "other"}
transformers pytorch llama text-generation license:other autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers.

This is a GPTQ 4 bit quant of ChanSung's Elina 33b.
This is a LlaMa based model; LoRA merged with latest transformers conversion.
Quantized with GPTQ, --wbits 4 --act-order --true-sequential --save_safetensors c4.

128 groupsize was not used so those running this on a consumer GPU with 24GB VRAM can run it at full
context (2048) without any risk of OOM.


Original LoRA:
URL


Repo:
URL


Likely Author:
URL
TAGS
#transformers #pytorch #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #pytorch #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
