Issues with Pythia model finetuning
Hi,I have been trying to fine tune the pythia 70m model on StackExchange dataset but it’s giving these errors:IndexError: Invalid key: 721 is out of bounds for size 0Can you please guide me a bit to understand where I am making mistake?gist.github.comhttps://gist.github.com/rpalsaxena/762909fae03f421f5ac87c9193083055pythia.ipynb{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/gist/rpalsaxena/762909fae03f421f5ac87c9193083055/pythia.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"This file has been truncated.show original
2023-10-03T07:51:30Z
I cannot see your code but I got a similar error. I found the solutionhere:you need to add a TrainingArguments to your Trainer, withremove_unused_columns=False(see the link for details)