
# ReluFalcon-40B-PowerInfer-GGUF 

- Original model: [SparseLLM/ReluFalcon-40B](https://huggingface.co/SparseLLM/ReluFalcon-40B)
- Converted & distributed by: [PowerInfer](https://huggingface.co/PowerInfer)

This model is the downstream distribution of [SparseLLM/ReluFalcon-40B](https://huggingface.co/SparseLLM/ReluFalcon-40B) in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.
{"language": ["en"], "license": "apache-2.0"}
transformers gguf relufalcon en license:apache-2.0 endpoints_compatible region:us