
playing around
from https://huggingface.co/docs/transformers/main/main_classes/quantization

{"license": "mit"}
transformers safetensors opt text-generation license:mit autotrain_compatible endpoints_compatible text-generation-inference 4-bit region:us