llava-v1.6-mistral-7b-hf-nf4 is a bnb nf4 quant of llava-v1.6-mistral-7b-hf.

For batch processing you can use ide-cap-chan

All other features are inherited from the parent model.

Downloads last month
5
Safetensors
Model size
4.03B params
Tensor type
F32
FP16
U8
Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for 2dameneko/llava-v1.6-mistral-7b-hf-nf4

Quantized
(2)
this model