Add training logs

README.md

@@ -47,6 +47,7 @@ https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/tem
       1. [Main pre-training](#1-main-pre-training)
       2. [Context Extension](#2-context-extension)
       3. [Annealing](#3-annealing)
+  * [Training logs and learning curves](#training-logs-and-learning-curves)
 <!-- * [Evaluation](#evaluation) -->
 * [Acknowledgements](#acknowledgements)
 * [Contact](#contact)
@@ -237,6 +238,16 @@ Training hyperparameters are the same as above, with the following changes:
 
 TODO
 
+### Training logs and learning curves
+
+🚧 work in progress 🚧
+
+Training logs can be found in Tensorboard format in:
+* [`metadata/training_logs/`](metadata/training_logs)
+<br> ├── [`1_pretraining.zip`](metadata/training_logs/1_pretraining.zip) training logs for the first pre-training phases,
+in a zip file. Each file in the zip corresponds to a job of at most 20H of training (parallelized over 512 GPUs).
+<br> └── [`2_extension/`](metadata/training_logs/2_extension) folder containing the training log for the context extension phase, which was done in a single job of around 13H of training (parallelized over 128 GPUs).
+
 ## Acknowledgements
 
 This work was performed using HPC resources from GENCI–IDRIS (Grant 2024-GC011015444).

metadata/training_logs/1_pretraining.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:debd5c63735b96a9e62fa5b44b0127c9452c341047ec2b919f82d8612674edce
+size 418213162

metadata/training_logs/2_extension/events.out.tfevents.1731919080.jzxh169.2097150.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e922e0c4112bf78d634ff506c400a651620f43e966b11e2a6fe98206c6e9a423
+size 3379212