# Original description

https://wandb.ai/open-assistant/supervised-finetuning/runs/i9gmn0dt

Trained with residual dropout 0.1

# What is this

This is https://huggingface.co/dvruette/llama-13b-pretrained-dropout quantized to int4, groupsize 128.

Run in text-generation-webui with --wbits 4 and --groupsize 128. 

{"inference": false}
transformers pytorch llama text-generation autotrain_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #text-generation-inference #region-us 

# Original description

URL

Trained with residual dropout 0.1

# What is this

This is URL quantized to int4, groupsize 128.

Run in text-generation-webui with --wbits 4 and --groupsize 128. 

# Original description

URL

Trained with residual dropout 0.1 # What is this

This is URL quantized to int4, groupsize 128.

Run in text-generation-webui with --wbits 4 and --groupsize 128.
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #text-generation-inference #region-us 
 # Original description

URL

Trained with residual dropout 0.1 # What is this

This is URL quantized to int4, groupsize 128.

Run in text-generation-webui with --wbits 4 and --groupsize 128.
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #text-generation-inference #region-us 
# Original description

URL

Trained with residual dropout 0.1# What is this

This is URL quantized to int4, groupsize 128.

Run in text-generation-webui with --wbits 4 and --groupsize 128.