| library_name: transformers | |
| tags: | |
| - AWQ | |
| - Miqu | |
| - Senku | |
| A quantized version of [Shinoji Research's Senku 70B Full](https://huggingface.co/ShinojiResearch/Senku-70B-Full). Quantized through AWQ: | |
| Quantization settings: | |
| ``` | |
| {"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" } | |
| ``` |