Fine-tuning Wav2v2.0: Loss increasing, WER decreasing
I’m fine-tuning the XLS-R large on my own dataset. After 20 epochs, the validation loss keeps increasing while  validation WER keeps decreasing? Is this a sign of overfitting?
2023-06-15T18:35:52Z
@ngoquanghuyI’m facing the opposite issue where the loss keeps decreasing whereas the WER keeps increasing (to the point where it’s 2x worse than a model not fine-tuned at all). Did you figure it out?
2023-06-30T03:33:34Z
@iamgroot42Ignore the WER. Loss is the most truthful factor.