Fine-tuning Wav2Vec2 for English ASR with 🤗 on local machine Transformers
I’m runninghttps://huggingface.co/blog/fine-tune-wav2vec2-english#training–evaluationexample on my local machine and gettingTraining Loss=nanStepTraining LossValidation LossWerRuntimeSamples Per Second200nan13.8429482.703102204.1995008.227000400nan13.8429482.703102204.3010008.223000600nan13.8429482.703102204.3717008.220000Local modifications to the exampletraining_args = TrainingArguments(output_dir="./wav2vec2-base-timit-demo",group_by_length=True,per_device_train_batch_size=4, ** changes from 32 **…save_steps=200,eval_steps=200,logging_steps=100,…)
2021-08-10T17:27:24Z
Update - by moving the job to the CPU the Training loss is getting values.steps so farmake cuda unavailableimport torchtorch.cuda.is_available = lambda : Falsedisabling Mixed precisiontraining_args = TrainingArguments(…# fp16=True,…)*Mixed precision training with AMP or APEX (--fp16) and FP16 evaluation can only be used on CUDA devices.  *