Setting device_map to "auto" will automatically determine how to load and store the model weights in the most optimized 
manner given existing devices.
Quantized model
If high-memory GPU availability is an issue, you can load the quantized version of the model. To load the model and the 
processor in 4bit precision, pass a BitsAndBytesConfig to the from_pretrained method and the model will be compressed 
on the fly while loading.