Anthonyg5005
/

c4ai-command-r7b-12-2024-exl2

Model card Files Files and versions Community

c4ai-command-r7b-12-2024-exl2 / README.md

Anthonyg5005's picture

Add temp README

57ff136 verified 4 days ago

|

history blame contribute delete

1.06 kB

Exl2 quants for c4ai-command-r7b-12-2024

Automatically quantized using the auto quant script from hf-scripts

BPW:

2.8
3.5
4.25
4.5
5.0
6.0
6.5
8.0
measurement.json