HuggingFace with Sagemaker tutorial doesn't work
Hi.I am going through the HuggingFace - Sagemaker tutorial that you provide in github. I am working with the notebook 1 : 01_getting_started_pytorch. I am using Sagemaker Studio with the image:Python 3 (PyTorch 1.6 Python 3.6 CPU Optimized)When I try to download the imdb dataset I have this error:image1376×808 135 KBDo someone know how to fix this issue?Thanks in advance.Sergio
2021-08-25T14:15:01Z
Hey@Oigres,which datasets version have you installed?
2021-08-25T14:44:51Z
I tried to reproduce your error but for me it worked with the notebook.image1310×276 38.5 KBCould you try removing the cache at/root/.cache/huggingface
2021-08-25T14:49:59Z
Hi.Thank you for you attention. I tried with these versions:Using the “pip install” that come already with the notebook:!pip install "sagemaker>=2.48.0" "transformers==4.6.1" "datasets[s3]==1.6.2" --upgradeI this case the version installed are:dataset 1.6.2andtransformers 4.6.1Using the “pip install” that is used in the youtube video related to this tutorial:!pip install transformers “datasets[s3]” --upgradeI this case the version installed are:dataset 4.9.2andtransformers 1.11.0In both cases I got the same error.
2021-08-25T15:12:57Z
I used the notebook as it is with!pip install "sagemaker>=2.48.0" "transformers==4.6.1" "datasets[s3]==1.6.2" --upgradeHave you tried restarting the kernel?And you might need to usesudo rm -rf
2021-08-25T16:13:28Z
Hey.Thank you very much. You did help me a lot. It was kind of these errors that you can’t find easily over there.Just a thing: in order to help others, can you edit your answer…? I’m sure that where you wrote:~/.cache/huggingfaceyou meant/root/.cache/huggingfaceMANY THANKS again.Oigres.