Update README.md
Browse files
README.md
CHANGED
@@ -12,9 +12,15 @@ pipeline_tag: text-classification
|
|
12 |
### Model Description
|
13 |
Finetuned xlm-roberta-base for Sentiment Analysis
|
14 |
### Training results
|
15 |
-
|
|
|
|
|
|
|
|
|
|
|
16 |
### Training procedure
|
17 |
For replication, go to [GitHub page](https://github.com/carant-ai/tpu-sentiment-trainer/tree/main)
|
18 |
### Special Thanks
|
19 |
-
1.
|
20 |
-
2.
|
|
|
|
12 |
### Model Description
|
13 |
Finetuned xlm-roberta-base for Sentiment Analysis
|
14 |
### Training results
|
15 |
+
Trained on TPU VM v4-8 for ~3 hours
|
16 |
+
|epoch|step|train_accuracy|train_loss|val_accuracy|val_loss|
|
17 |
+
| --- | --- | --- | --- | --- | --- |
|
18 |
+
|0|5391|0.955597997|0.118527733|0.963498533|0.098501749|
|
19 |
+
|1|10783|0.965486944|0.092906699|0.964689374|0.094814248|
|
20 |
+
|2|16175|0.968293846|0.085916176|0.965770006|0.093040377|
|
21 |
### Training procedure
|
22 |
For replication, go to [GitHub page](https://github.com/carant-ai/tpu-sentiment-trainer/tree/main)
|
23 |
### Special Thanks
|
24 |
+
1. Google’s TPU Research Cloud (TRC) for providing Cloud TPU VM.
|
25 |
+
2. [carlesoctav](https://huggingface.co/carlesoctav) for making the training script on TPU VM
|
26 |
+
3. [thonyyy](https://huggingface.co/thonyyy) for gathering the sentiment dataset
|