Tips:

[BertGenerationEncoder] and [BertGenerationDecoder] should be used in
  combination with [EncoderDecoder].
For summarization, sentence splitting, sentence fusion and translation, no special tokens are required for the input.
  Therefore, no EOS token should be added to the end of the input.