Distributed training and mixed precision
The Trainer supports distributed training and mixed precision, which means you can also use it in a script. To enable both of these features:

Add the fp16 argument to enable mixed precision.
Set the number of GPUs to use with the nproc_per_node argument.