Generate 5 questions for the following passage:
You don't need to actually come up with all the questions, you just give it some questions and answers about a specific paper, that's how it will be able to construct a sort of knowledge and it will be able to answer new questions using its analytic abilities.
So you will need a pipeline that will automate question generation. Here is an example:
You provide GPT-4 with one page of the scientific paper + abstract + conclusion and ask it to generate questions.
You ask it to answer those questions.
You do this in a loop for all the pages you want.
With the collected dataset you fine tune the model with the question/answers generated from a list of papers.
When the model is fine tuned, you can ask it other questions that are not in the dataset.
You can augment the GPT-4 questions with a hidden prompt that you do not need to provide to the fine tuned model.
For example, the first line in the prompt asks it to cite the current paper or other papers for each sentence in the answer.