
This model is the 4bit quantized version of the alpaca-7b model.

Created with the https://github.com/oobabooga/GPTQ-for-LLaMa repository for better compatibility to text-generation-webui.

Use with `--wbits 4` and `--groupsize 128`
{"license": "other"}
transformers llama text-generation license:other autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


This model is the 4bit quantized version of the alpaca-7b model.

Created with the URL repository for better compatibility to text-generation-webui.

Use with '--wbits 4' and '--groupsize 128'
TAGS
#transformers #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #llama #text-generation #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
