Is it possible to perform local dev on a CPU-only machine on HF/sagemaker?
I’m trying to dev locally onsagemaker.huggingface.HuggingFacebefore moving to sagemaker for actual training. I set up aHF_estimator = HuggingFace(entry_point='train.py', instance_type='local' ...)And calledHF_estimator.fit()Intrain.pyim simply printing and exiting to see if it will work. However I ran into this:ValueError: Unsupported processor: cpu. You may need to upgrade your SDK version (pip install -U sagemaker) for newer processors. Supported processor(s): gpu.Is it possible to bypass this for local development?
2022-06-13T08:37:44Z
Hello@plamb,Currently, there are only GPU DLCs for Training Hugging Face Models. What you could is execute yourtrain.pywithpython3 train.pyand pass in your hyperparameters (dict) as cli args with--key value