Use decoder_input_ids with deepspeed
Hello,This is a question about how to usedecoder_input_idswith deepspeed.I have a language generation task that hasdecoder_input_ids. For example, I need the generation model to start the generation with ‘yes’.My solution is that I pass thedecoder_input_idstomodel.generate()byinputs['decoder_input_ids']withinSeq2SeqTrainer, is this the right way?Edit: It doesn’t seem to work that way. I suspect that the trainer.py does not parse thedecoder_input_idsas an argument inside themodel(*input). Any suggestions?