Finetune GPT2on ATOMIC2020
Description: We will finetune GPT2-JAX on ATOMIC2020 so that we can generate vertices for knowledge graphsModel:GPT2-LargeDataset:ATOMIC2020Training scripts: Training scripts and data processing scripts will be written as part of the projectExpected result: An adaptable JAX pipeline for training knowledge graph systems.