Load model from local cache directory in Sagemaker notebooks
We are downloading the model weights for llama2 70b from hugging face and specifying the local cache directory on day 1.In the day 2 when we try to load the model from cache directory it just hangs on there.More specifically lets say on day 1 I am loading the models and storing in cache dir.Rest of the day it works fine.But after stopping the instance and again starting on day 2 model loading just keeps hanging unless and until we delete the cache directory and load the weights again from huggingface.How can we get around this problem?