I am using the huggingface estimator to train my model and use managed spot instance. I notice that the checkpoints persist after starting the whole training process from scratch.
How do I manage this checkpoint data folder in the instance? Or more simply how can I remove the checkpoints when I restart the instance or do I delete the whole endpoint/instance where the model is trained and how do I do this?