Build a news summarizer
DescriptionA common data science task for many business is to be able to condense the news about their products or services into short summaries. The goal of this task is to fine-tune a model to automatically summarise news articles, ideally in a domain that is of interest to you!Model(s)There are various summarisation models on the Hub that have been fine-tuned on the famous CNN/Dailymail dataset. These provide a good starting point for performing domain adaptation:google/pegasus-cnn_dailymailgoogle/roberta2roberta_L-24_cnn_daily_mailThere are also other summarization models that are worth investigating:facebook/bart-large-cnnDatasetsUsing thesummarizationfilter on theHugging Face Hubgives a good list of datasets to start from.Challenges[Explain whether the task is feasible with a single T4 GPU (what we get from AWS), does the data need a lot of preprocessing, are there ethical considerations etc]Desired project outcomesCreate a Streamlit or Gradio app onSpacesthat can summarize news articles, either from their text or from a given URL.Don’t forget to push all your models and datasets to the Hub so others can build on them!Additional resourcesHere are some existing spaces as inspiration:https://huggingface.co/spaces/chinhon/News_Summarizerhttps://huggingface.co/spaces/benthecoder/news-summarizerDiscord channelTo chat and organise with other people interested in this project, head over to ourDiscordand:Follow the instructions on the#join-coursechannelJoin the#new-summarizerchannelJust make sure you comment here to indicate that you’ll be contributing to this project
2021-11-15T19:27:12Z
Hi Lewis, I am interested in working on a text summarizer as my course project. How can I join this project? - Ali
2021-11-15T21:23:37Z
Hi@Alifarsiyou can check out the Discord channel I created (see the project description) and get started with finding a suitable dataset / model for this task
2021-11-17T13:54:53Z
Is there any slot for this project?
2021-11-17T16:15:42Z
Hey@aozorahimeI suggest checking with the existing team in the Discord channel. If it’s full I can create a new team for you and others
2021-11-18T15:03:31Z
Interested , let me know any one is creating team, will join !
2021-11-18T21:25:03Z
Hey@Saitejayou can check out if the team is full in the Discord channel. If it’s already 4 people, I can create a new team for you and others
2021-11-19T05:23:13Z
Thank you@lewtun!