[pegasus] evaluation datasets and build scripts are now available
Accomplished by@sshleifer,@valhallaand yours truly, we have now released 11 evaluation datasets used for evaluatingpegasus. FortransformersAPI seePegasus.The datasets are available directly from s3. All the build instructions/scripts are available as well.You will find them inthis repo.The list includes:aeslcarxivbig_patentbillsumcnn_dailymailgigawordmulti_newsnewsroompubmedreddit_tifuwikihowxsumWe couldn’t figure out how to build thebig_patentdataset - as we couldn’t build this arrow dataset, seehttps://github.com/google-research/pegasus/issues/114- if you can help to build it, it’d be amazing!