huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B. Both 4bit-128g and 4bit non-groupsize versions are on my repo as well.
{}
transformers pytorch llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B. Both 4bit-128g and 4bit non-groupsize versions are on my repo as well.
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
