solidrust
/

Mixtral-3x7B-Instruct-v0.1-AWQ

Text Generation

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

fxmeng/Mixtral-3x7B-Instruct-v0.1 AWQ

Model creator: fxmeng
Original model: Mixtral-3x7B-Instruct-v0.1

Model Summary

Author does not provide details

Downloads last month: 5

Safetensors

Model size

2.7B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ

Base model

fxmeng/Mixtral-3x7B-Instruct-v0.1

Quantized

(1)

this model

Collection including solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ

3x7B AWQ

Mixture of experts 3 x 7B. • 5 items • Updated Apr 25, 2024