Leveraging Pre-trained Checkpoints for Sequence Generation Tasks.

Unsupervised pre-training of large neural models has recently revolutionized Natural Language Processing. By warm-starting from the publicly released checkpoints, NLP practitioners have pushed the ...