nicholasKluge
/

Aira-2-124M

Text Generation

instruction tuned

text generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

nicholasKluge commited on Sep 14, 2023

Commit

bdf2d2c

·

1 Parent(s): 7e2fbd0

Upload AIRA_FineTuning.ipynb

Files changed (1) hide show

AIRA_FineTuning.ipynb +6 -6

AIRA_FineTuning.ipynb CHANGED Viewed

@@ -783,7 +783,7 @@
         "id": "vSqKuRjIe8ru"
       },
       "source": [
-        "8. Create the `DataLoaders` and specify the `batch_size`."
       ]
     },
     {
@@ -809,7 +809,7 @@
         "id": "0vxvcTIHe8rv"
       },
       "source": [
-        "9. Load the base model (`GPT2LMHeadModel`)."
       ]
     },
     {
@@ -939,7 +939,7 @@
         "id": "XAoXD7GVYMN_"
       },
       "source": [
-        "10. Freeze some of the layers for constrained fine-tuning. This allows the model to retain some of its original capabilities after the tuning."
       ]
     },
     {
@@ -998,7 +998,7 @@
         "id": "GJ1kH3uSe8rw"
       },
       "source": [
-        "11. Set the training hyperparameters."
       ]
     },
     {
@@ -1037,7 +1037,7 @@
         "id": "nz1a9lxXe8rw"
       },
       "source": [
-        "12. Training/Validation loop. Track the carbon emissions of your work by using `codecarbon`. 🌱"
       ]
     },
     {
@@ -1635,7 +1635,7 @@
         "id": "h48iOsqie8rx"
       },
       "source": [
-        "13. Check the training stats and plot the learning curves."
       ]
     },
     {

         "id": "vSqKuRjIe8ru"
       },
       "source": [
+        "7. Create the `DataLoaders` and specify the `batch_size`."
       ]
     },
     {
         "id": "0vxvcTIHe8rv"
       },
       "source": [
+        "8. Load the base model (`GPT2LMHeadModel`)."
       ]
     },
     {
         "id": "XAoXD7GVYMN_"
       },
       "source": [
+        "9. Freeze some of the layers for constrained fine-tuning. This allows the model to retain some of its original capabilities after the tuning."
       ]
     },
     {
         "id": "GJ1kH3uSe8rw"
       },
       "source": [
+        "10. Set the training hyperparameters."
       ]
     },
     {
         "id": "nz1a9lxXe8rw"
       },
       "source": [
+        "11. Training/Validation loop. Track the carbon emissions of your work by using `codecarbon`. 🌱"
       ]
     },
     {
         "id": "h48iOsqie8rx"
       },
       "source": [
+        "12. Check the training stats and plot the learning curves."
       ]
     },
     {