mradermacher
/

vikhr_nemo_orpo_dostoevsky_12b-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

vikhr_nemo_orpo_dostoevsky_12b-i1-GGUF

1 contributor

History: 16 commits

mradermacher's picture

uploaded from marco

1c3ae3f verified 24 days ago

.gitattributes

2.63 kB

uploaded from marco 24 days ago
README.md

248 Bytes

uploaded from marco 24 days ago
imatrix.dat

7.05 MB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ1_M.gguf

3.22 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ2_M.gguf

4.44 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ3_M.gguf

5.72 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ3_XXS.gguf

4.95 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ4_NL.gguf

7.1 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-IQ4_XS.gguf

6.74 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q2_K.gguf

4.79 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q2_K_S.gguf

4.49 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q3_K_M.gguf

6.08 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q3_K_S.gguf

5.53 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q4_K_M.gguf

7.48 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q4_K_S.gguf

7.12 GB
LFS

uploaded from marco 24 days ago
vikhr_nemo_orpo_dostoevsky_12b.i1-Q6_K.gguf

10.1 GB
LFS

uploaded from marco 24 days ago