Instantiating a big model
When you want to use a very big pretrained model, one challenge is to minimize the use of the RAM. The usual workflow
from PyTorch is:

Create your model with random weights.
Load your pretrained weights.
Put those pretrained weights in your random model.