Which summarization model of huggingface supports more than 1024 tokens? Which model is more suitable for programming related articles?
If this is not the best place to ask this question please lead me to the most accurate one.I am planning to use huggingface summarization (Models - Hugging Face) to summarize my lecture videos transcriptionsSo far I have testedfacebook/bart-large-cnnandsshleifer/distilbart-cnn-12-6but they support maximum 1024 tokens as inputsSo here my questions1: Are there any summarization model that supports longer inputs like 10000 words article?2: What are the optimal output lengths for given input lengths? Lets say for 1000 words input, how much should be the optimal minimum output length (the min length of the summarized text)3: Which model would likely to work on programming related articles?Please give me model name from this repository :Models - Hugging Face
2023-07-31T09:07:14Z
Hi, not sure if you still answer to your question, however here are some options you can try:LED (16k token input length) -allenai/led-base-16384 · Hugging FacePRIMERA (~4k token input length) -allenai/PRIMERA · Hugging FaceUnlimiformer (unlimited input length?) -abertsch/unlimiformer-bart-govreport-alternating · Hugging Face(read the description first!)