FP16 is not supported (help/ideas on this appreciated!).

The adafactor optimizer is recommended for pegasus fine-tuning.

Checkpoints
All the checkpoints are fine-tuned for summarization, besides
pegasus-large, whence the other checkpoints are fine-tuned: