The training loss(logging steps) will drop suddenly after each epoch? Help me plz! Orz
I obtained unsmooth loss(according to trainer_state.json) curve after training CLIP demo(transformers/examples/pytorch/contrastive-image-text at main · huggingface/transformers · GitHub)image1920×991 71.3 KBI record detail inThe training loss(logging steps) will drop suddenly after each epoch? Help me plz! Orz · Issue #18730 · huggingface/transformers · GitHubCould any one help me?
2022-08-26T03:27:40Z
I checked the logged values for each step(according to trainer_state.json) and found the loss value(dataloader_drop_last=True) dropped significantlyat the first stepof each epoch.