transformers safetensors llama text-generation license:other autotrain_compatible endpoints_compatible text-generation-inference 4-bit bitsandbytes region:us
---
license: other
license_name: qwen
license_link: LICENSE
---


Prompt Example:
```

### Human: 
Explain how AGI and collective intelligence are logically connected. 

### Assistant: 
```

Quantization settings: 

{'load_in_4bit': True, 'bnb_4bit_compute_dtype': torch.bfloat16, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True}