Generation utils for pytorch transformers
Hello,I have a encoder-decoder transformer model using normal pytorch functions (nn.TransformerEncoder, nn.TransformerDecoder) which I have managed to train. I am hoping to using huggingface’s implementation of beam search with this model.So the question is, is there a way to add the generation utilities mentioned here:Generation. If not, is what is the equivalent of using Huggingface’snn.TransformerEncoder, nn.TransformerEncoderLayer, nn.TransformerDecoder, nn.TransformerDecoderLayerso that I can use the generate functionvia huggingface transformers instead.
2023-04-01T06:39:49Z
sachin:TransformerDecoderI am looking for something similar. Were you able to find a solution for this?