Decoder_start_token_id per sample or per batch during training
Hi All,I’m working on a Translation model using EncoderDecoderModel.Each batch contains samples only from one language.How can we definedecoder_start_token_idper each batch?Sometimes,decoder_start_token_idis<ENG>and sometimes it’s<FRE>I usemodel.module.config.decoder_start_token_idto changedecoder_start_token_idper each batch. But this is causing lots of inconsistency when using Multiple GPUs and DeepSpeed.Any suggestions?It seemsforwardfunction does not supportdecoder_start_token_id. Onlygeneratefunction supports it. However, I need to specifydecoder_start_token_idper each batch during training.Any suggestions?Thank you