nm-testing
/

pixtral-12b-W8A8

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Resources

View closed (0)

Getting incoherent output on vLLM with 2080Ti and 3090Ti

#1 opened about 2 months ago by