FusionNet_7Bx2_MoE_14B
- Original model: FusionNet_7Bx2_MoE_14B
Description
This repo contains GGUF format model files for FusionNet_7Bx2_MoE_14B.
Provided files
| Name | Quantisation method | Bits | Size |
|---|---|---|---|
| FusionNet_7Bx2_MoE_14B-Q3_K_S.gguf | Q3_KS | 3 | 5.59 GB |
| FusionNet_7Bx2_MoE_14B-Q3_K.gguf | Q3_K | 3 | 6.21 GB |
| FusionNet_7Bx2_MoE_14B-Q4_0.gguf | Q4_0 | 4 | 7.28 GB |
| FusionNet_7Bx2_MoE_14B-Q4_K_S.gguf | Q4_K_S | 4 | 7.34 GB |
| FusionNet_7Bx2_MoE_14B-Q4_K.gguf | Q4_K | 4 | 7.78 GB |
| FusionNet_7Bx2_MoE_14B-Q4_1.gguf | Q4_1 | 4 | 8.08 GB |
| FusionNet_7Bx2_MoE_14B-Q5_K_S.gguf | Q5_KS | 5 | 8.87 GB |
| FusionNet_7Bx2_MoE_14B-Q5_K.gguf | Q5_K | 5 | 9.13 GB |
| FusionNet_7Bx2_MoE_14B-Q6_K.gguf | Q6_K | 6 | 10.6 GB |
| FusionNet_7Bx2_MoE_14B-Q8_0.gguf | Q8_0 | 8 | 13.7 GB |
- Downloads last month
- 119
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for Nan-Do/FusionNet_7Bx2_MoE_14B-GGUF
Base model
TomGrc/FusionNet_7Bx2_MoE_14B