🌸 This model is intended to be compatible with <a href="https://github.com/CortexLM/flavia.git">Flavia</a>


## Qwen-72B: A Quantized Model with W4A16
**Overview**

Qwen-72B is our latest breakthrough in machine learning models, featuring a quantization framework with W4A16 (4-bit weights and 16-bit activations). This model is designed to deliver state-of-the-art performance in natural language processing tasks while being significantly more efficient in terms of memory usage and computational resources.

**Features**

**Quantization:** 

Utilizing 4-bit weights and 16-bit activations, Qwen-72B maintains high accuracy while reducing model size and computational demand.

**Performance:** 

Despite its quantized size, Qwen-72B comes close to the performance of larger, unquantified models in benchmark tests.

Model Size: 72 billion parameters
Quantization Scheme: W4A16
API Compatibility: Fully compatible with Flavia - Model Inference Bittensor Subnet ρ (SN17)

**Engine**

LMDeploy
{"language": ["zh", "en"], "license": "other", "tags": ["qwen"], "pipeline_tag": "text-generation", "inference": false, "license_name": "tongyi-qianwen-license-agreement", "license_link": "https://github.com/QwenLM/Qwen/blob/main/Tongyi%20Qianwen%20LICENSE%20AGREEMENT"}
transformers pytorch qwen text-generation custom_code zh en license:other autotrain_compatible region:us