Seq2Seq Learning rate
I have fine tuning the Flan t5 using the seq2seq trainer what i have observe that while training the learning rate is changing. But  i have set the learning rate fixed.WHy this thing is happening how to control it ??
2024-01-16T13:17:06Z
Hi@rishilearn, I’m guessing thelr_scheduler_typetraining argument is using the default value (linear), which means the learning rate will decay linearly during training. Try setting that to “constant”.
2024-03-06T05:06:47Z
Thanks for the suggestion@dblakelyi will try it out.