Longformer for sequenceclassification
I am using the Longformer for sequence classification task (taking example code from here), the model is running somehow on a small batch, the issue is with the wrong predictions, is there any example of the Longformer sequence classification for GLUE tasks.thanks
2020-10-13T07:20:31Z
try the example scripthere
2020-10-13T10:28:09Z
thanks, so instead of   --model_name_or_path bert-base-multilingual-uncased , I could use longformer?
2020-10-13T10:49:25Z
Yes, all you’ll need to do is change the model name!
2020-10-13T12:34:49Z
thanks@valhallaappreciate yours response everytime
2020-10-13T16:59:33Z
can you check this notebook quickly, where am I going wrong, the predictions are too poor, I just take a sample of dataset during fine-tuning because of performance issuegithub.comshainaraza/BERT/blob/master/Text_Classification_longformer_1.ipynb{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Text_Classification_longformer-1.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "machine_shape": "hm",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU",
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "a46df976c9f64e20a048114b7c69ae36": {
          "model_module": "@jupyter-widgets/controls",This file has been truncated.show original