Keyword generation using T5
Hey folks,I am trying to fine-tune a T5 for some sort ofkeyword generation.Due to the way I’ve created my dataset (extracting keywords from a summary of the actual text) the gold keywords that I have might not be present in the actual text. For this reason a token classification task would not work. Thus my idea of text to text generation !Ideally this would work like:>>> input_text = "question: What are the keywords? context: [DOCUMENT]"
>>> inputs = tokenizer(input_text)
>>> outputs = model.generate(**inputs)
>>> print(tokenizer.decode(outputs))
finance - crisis - stocksMy main concern is that LM are actually trained to generate syntactically correct sentence. Would this be problematic?Has anyone tried to perform a similar task or has any suggestion on how I could tackle this problem from a different angle?Cheers!
2022-07-14T11:14:35Z
Interested to know how this one is coming along?
2022-09-12T09:04:27Z
What model are you using? QA model or Seq2seqLM model? I’m just trying to do something similar…
2022-09-12T09:21:39Z
I actually tried both and none led to promising result (I didn’t really dug much tbh)
2022-11-02T04:41:11Z
Hi, so text2text is not returning promising results, should I try token classification if my keywords are present in the context?