Hugging Face's logo

JEdward7777
/
finetuned-xlm-r-masakhaner-swa-whole-word-phonetic

Fill-Mask
Transformers
PyTorch
TensorBoard
xlm-roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
JEdward7777 commited on
Commit
c2a7b56
·
1 Parent(s): 2db0131

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +507 -57
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 15.5961
18
 
19
  ## Model description
20
 
@@ -39,67 +39,517 @@ The following hyperparameters were used during training:
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
- - num_epochs: 50
43
 
44
  ### Training results
45
 
46
- | Training Loss | Epoch | Step | Validation Loss |
47
- |:-------------:|:-----:|:----:|:---------------:|
48
- | No log | 1.0 | 62 | 39.6873 |
49
- | No log | 2.0 | 124 | 39.5168 |
50
- | No log | 3.0 | 186 | 38.9323 |
51
- | No log | 4.0 | 248 | 37.7971 |
52
- | No log | 5.0 | 310 | 36.8967 |
53
- | No log | 6.0 | 372 | 35.3844 |
54
- | No log | 7.0 | 434 | 34.6435 |
55
- | No log | 8.0 | 496 | 33.6444 |
56
- | 39.4735 | 9.0 | 558 | 32.8915 |
57
- | 39.4735 | 10.0 | 620 | 31.1389 |
58
- | 39.4735 | 11.0 | 682 | 30.0209 |
59
- | 39.4735 | 12.0 | 744 | 28.7981 |
60
- | 39.4735 | 13.0 | 806 | 27.6728 |
61
- | 39.4735 | 14.0 | 868 | 26.6111 |
62
- | 39.4735 | 15.0 | 930 | 25.5562 |
63
- | 39.4735 | 16.0 | 992 | 24.4283 |
64
- | 29.1909 | 17.0 | 1054 | 23.2272 |
65
- | 29.1909 | 18.0 | 1116 | 22.8566 |
66
- | 29.1909 | 19.0 | 1178 | 22.1741 |
67
- | 29.1909 | 20.0 | 1240 | 21.4192 |
68
- | 29.1909 | 21.0 | 1302 | 20.4911 |
69
- | 29.1909 | 22.0 | 1364 | 20.2457 |
70
- | 29.1909 | 23.0 | 1426 | 19.5857 |
71
- | 29.1909 | 24.0 | 1488 | 19.2878 |
72
- | 21.7917 | 25.0 | 1550 | 18.8065 |
73
- | 21.7917 | 26.0 | 1612 | 18.3365 |
74
- | 21.7917 | 27.0 | 1674 | 18.1690 |
75
- | 21.7917 | 28.0 | 1736 | 17.5599 |
76
- | 21.7917 | 29.0 | 1798 | 17.4295 |
77
- | 21.7917 | 30.0 | 1860 | 17.1918 |
78
- | 21.7917 | 31.0 | 1922 | 16.9913 |
79
- | 21.7917 | 32.0 | 1984 | 16.7378 |
80
- | 18.0017 | 33.0 | 2046 | 16.5858 |
81
- | 18.0017 | 34.0 | 2108 | 16.4158 |
82
- | 18.0017 | 35.0 | 2170 | 16.2602 |
83
- | 18.0017 | 36.0 | 2232 | 16.0334 |
84
- | 18.0017 | 37.0 | 2294 | 16.0809 |
85
- | 18.0017 | 38.0 | 2356 | 15.7176 |
86
- | 18.0017 | 39.0 | 2418 | 15.8248 |
87
- | 18.0017 | 40.0 | 2480 | 15.8528 |
88
- | 16.124 | 41.0 | 2542 | 15.7772 |
89
- | 16.124 | 42.0 | 2604 | 15.7973 |
90
- | 16.124 | 43.0 | 2666 | 15.4572 |
91
- | 16.124 | 44.0 | 2728 | 15.6225 |
92
- | 16.124 | 45.0 | 2790 | 15.4301 |
93
- | 16.124 | 46.0 | 2852 | 15.7354 |
94
- | 16.124 | 47.0 | 2914 | 15.5296 |
95
- | 16.124 | 48.0 | 2976 | 15.4213 |
96
- | 15.3787 | 49.0 | 3038 | 15.5128 |
97
- | 15.3787 | 50.0 | 3100 | 15.5961 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
98
 
99
 
100
  ### Framework versions
101
 
102
- - Transformers 4.21.2
103
- - Pytorch 1.12.1+cu113
104
- - Datasets 2.4.0
105
  - Tokenizers 0.12.1
 
14
 
15
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 10.9759
18
 
19
  ## Model description
20
 
 
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
+ - num_epochs: 500
43
 
44
  ### Training results
45
 
46
+ | Training Loss | Epoch | Step | Validation Loss |
47
+ |:-------------:|:-----:|:-----:|:---------------:|
48
+ | No log | 1.0 | 62 | 40.0624 |
49
+ | No log | 2.0 | 124 | 39.4729 |
50
+ | No log | 3.0 | 186 | 39.0082 |
51
+ | No log | 4.0 | 248 | 38.2032 |
52
+ | No log | 5.0 | 310 | 37.3358 |
53
+ | No log | 6.0 | 372 | 36.1574 |
54
+ | No log | 7.0 | 434 | 35.1500 |
55
+ | No log | 8.0 | 496 | 33.6943 |
56
+ | 39.2118 | 9.0 | 558 | 32.3968 |
57
+ | 39.2118 | 10.0 | 620 | 30.7308 |
58
+ | 39.2118 | 11.0 | 682 | 29.2279 |
59
+ | 39.2118 | 12.0 | 744 | 27.8274 |
60
+ | 39.2118 | 13.0 | 806 | 26.4941 |
61
+ | 39.2118 | 14.0 | 868 | 24.6593 |
62
+ | 39.2118 | 15.0 | 930 | 23.4405 |
63
+ | 39.2118 | 16.0 | 992 | 21.9994 |
64
+ | 27.5423 | 17.0 | 1054 | 21.0274 |
65
+ | 27.5423 | 18.0 | 1116 | 19.8907 |
66
+ | 27.5423 | 19.0 | 1178 | 19.3347 |
67
+ | 27.5423 | 20.0 | 1240 | 18.3241 |
68
+ | 27.5423 | 21.0 | 1302 | 17.5215 |
69
+ | 27.5423 | 22.0 | 1364 | 16.9689 |
70
+ | 27.5423 | 23.0 | 1426 | 16.2983 |
71
+ | 27.5423 | 24.0 | 1488 | 15.8707 |
72
+ | 18.4542 | 25.0 | 1550 | 15.4655 |
73
+ | 18.4542 | 26.0 | 1612 | 15.1849 |
74
+ | 18.4542 | 27.0 | 1674 | 14.7801 |
75
+ | 18.4542 | 28.0 | 1736 | 14.5576 |
76
+ | 18.4542 | 29.0 | 1798 | 14.4215 |
77
+ | 18.4542 | 30.0 | 1860 | 13.9318 |
78
+ | 18.4542 | 31.0 | 1922 | 13.9801 |
79
+ | 18.4542 | 32.0 | 1984 | 13.7096 |
80
+ | 13.9556 | 33.0 | 2046 | 13.4639 |
81
+ | 13.9556 | 34.0 | 2108 | 13.2987 |
82
+ | 13.9556 | 35.0 | 2170 | 13.2303 |
83
+ | 13.9556 | 36.0 | 2232 | 13.2450 |
84
+ | 13.9556 | 37.0 | 2294 | 13.0574 |
85
+ | 13.9556 | 38.0 | 2356 | 12.9022 |
86
+ | 13.9556 | 39.0 | 2418 | 12.8200 |
87
+ | 13.9556 | 40.0 | 2480 | 12.7295 |
88
+ | 12.111 | 41.0 | 2542 | 12.8402 |
89
+ | 12.111 | 42.0 | 2604 | 12.6906 |
90
+ | 12.111 | 43.0 | 2666 | 12.5422 |
91
+ | 12.111 | 44.0 | 2728 | 12.5032 |
92
+ | 12.111 | 45.0 | 2790 | 12.2968 |
93
+ | 12.111 | 46.0 | 2852 | 12.3324 |
94
+ | 12.111 | 47.0 | 2914 | 12.2543 |
95
+ | 12.111 | 48.0 | 2976 | 12.2434 |
96
+ | 11.3304 | 49.0 | 3038 | 12.2519 |
97
+ | 11.3304 | 50.0 | 3100 | 12.1120 |
98
+ | 11.3304 | 51.0 | 3162 | 12.1969 |
99
+ | 11.3304 | 52.0 | 3224 | 11.9977 |
100
+ | 11.3304 | 53.0 | 3286 | 12.1759 |
101
+ | 11.3304 | 54.0 | 3348 | 11.9808 |
102
+ | 11.3304 | 55.0 | 3410 | 12.1498 |
103
+ | 11.3304 | 56.0 | 3472 | 11.9851 |
104
+ | 10.9471 | 57.0 | 3534 | 12.0800 |
105
+ | 10.9471 | 58.0 | 3596 | 11.8819 |
106
+ | 10.9471 | 59.0 | 3658 | 12.0099 |
107
+ | 10.9471 | 60.0 | 3720 | 11.8616 |
108
+ | 10.9471 | 61.0 | 3782 | 11.8950 |
109
+ | 10.9471 | 62.0 | 3844 | 11.8301 |
110
+ | 10.9471 | 63.0 | 3906 | 12.0967 |
111
+ | 10.9471 | 64.0 | 3968 | 11.8379 |
112
+ | 10.6841 | 65.0 | 4030 | 11.9093 |
113
+ | 10.6841 | 66.0 | 4092 | 11.9175 |
114
+ | 10.6841 | 67.0 | 4154 | 11.7318 |
115
+ | 10.6841 | 68.0 | 4216 | 11.8300 |
116
+ | 10.6841 | 69.0 | 4278 | 11.5992 |
117
+ | 10.6841 | 70.0 | 4340 | 11.6044 |
118
+ | 10.6841 | 71.0 | 4402 | 11.6937 |
119
+ | 10.6841 | 72.0 | 4464 | 11.5960 |
120
+ | 10.542 | 73.0 | 4526 | 11.5451 |
121
+ | 10.542 | 74.0 | 4588 | 11.4033 |
122
+ | 10.542 | 75.0 | 4650 | 11.4805 |
123
+ | 10.542 | 76.0 | 4712 | 11.5396 |
124
+ | 10.542 | 77.0 | 4774 | 11.4924 |
125
+ | 10.542 | 78.0 | 4836 | 11.4289 |
126
+ | 10.542 | 79.0 | 4898 | 11.3646 |
127
+ | 10.542 | 80.0 | 4960 | 11.3624 |
128
+ | 10.4457 | 81.0 | 5022 | 11.4623 |
129
+ | 10.4457 | 82.0 | 5084 | 11.5224 |
130
+ | 10.4457 | 83.0 | 5146 | 11.4196 |
131
+ | 10.4457 | 84.0 | 5208 | 11.4359 |
132
+ | 10.4457 | 85.0 | 5270 | 11.4346 |
133
+ | 10.4457 | 86.0 | 5332 | 11.4639 |
134
+ | 10.4457 | 87.0 | 5394 | 11.2307 |
135
+ | 10.4457 | 88.0 | 5456 | 11.5262 |
136
+ | 10.3854 | 89.0 | 5518 | 11.6653 |
137
+ | 10.3854 | 90.0 | 5580 | 11.3471 |
138
+ | 10.3854 | 91.0 | 5642 | 11.3048 |
139
+ | 10.3854 | 92.0 | 5704 | 11.3633 |
140
+ | 10.3854 | 93.0 | 5766 | 11.3434 |
141
+ | 10.3854 | 94.0 | 5828 | 11.2580 |
142
+ | 10.3854 | 95.0 | 5890 | 11.2709 |
143
+ | 10.3854 | 96.0 | 5952 | 11.1983 |
144
+ | 10.324 | 97.0 | 6014 | 11.2218 |
145
+ | 10.324 | 98.0 | 6076 | 11.3307 |
146
+ | 10.324 | 99.0 | 6138 | 11.2036 |
147
+ | 10.324 | 100.0 | 6200 | 11.3724 |
148
+ | 10.324 | 101.0 | 6262 | 11.3443 |
149
+ | 10.324 | 102.0 | 6324 | 11.2646 |
150
+ | 10.324 | 103.0 | 6386 | 11.2717 |
151
+ | 10.324 | 104.0 | 6448 | 11.3106 |
152
+ | 10.2981 | 105.0 | 6510 | 11.2435 |
153
+ | 10.2981 | 106.0 | 6572 | 11.2492 |
154
+ | 10.2981 | 107.0 | 6634 | 11.1113 |
155
+ | 10.2981 | 108.0 | 6696 | 11.2106 |
156
+ | 10.2981 | 109.0 | 6758 | 11.2143 |
157
+ | 10.2981 | 110.0 | 6820 | 11.0152 |
158
+ | 10.2981 | 111.0 | 6882 | 11.0871 |
159
+ | 10.2981 | 112.0 | 6944 | 11.0981 |
160
+ | 10.2536 | 113.0 | 7006 | 11.2439 |
161
+ | 10.2536 | 114.0 | 7068 | 11.1562 |
162
+ | 10.2536 | 115.0 | 7130 | 11.1186 |
163
+ | 10.2536 | 116.0 | 7192 | 11.2282 |
164
+ | 10.2536 | 117.0 | 7254 | 11.2892 |
165
+ | 10.2536 | 118.0 | 7316 | 11.1659 |
166
+ | 10.2536 | 119.0 | 7378 | 11.3439 |
167
+ | 10.2536 | 120.0 | 7440 | 11.1999 |
168
+ | 10.2336 | 121.0 | 7502 | 11.2504 |
169
+ | 10.2336 | 122.0 | 7564 | 11.2896 |
170
+ | 10.2336 | 123.0 | 7626 | 11.0688 |
171
+ | 10.2336 | 124.0 | 7688 | 11.1674 |
172
+ | 10.2336 | 125.0 | 7750 | 11.2072 |
173
+ | 10.2336 | 126.0 | 7812 | 11.0353 |
174
+ | 10.2336 | 127.0 | 7874 | 11.0488 |
175
+ | 10.2336 | 128.0 | 7936 | 11.0932 |
176
+ | 10.2336 | 129.0 | 7998 | 11.0705 |
177
+ | 10.2101 | 130.0 | 8060 | 11.2193 |
178
+ | 10.2101 | 131.0 | 8122 | 11.2278 |
179
+ | 10.2101 | 132.0 | 8184 | 11.1365 |
180
+ | 10.2101 | 133.0 | 8246 | 11.0353 |
181
+ | 10.2101 | 134.0 | 8308 | 11.0146 |
182
+ | 10.2101 | 135.0 | 8370 | 11.2372 |
183
+ | 10.2101 | 136.0 | 8432 | 11.1044 |
184
+ | 10.2101 | 137.0 | 8494 | 11.1340 |
185
+ | 10.1991 | 138.0 | 8556 | 11.0753 |
186
+ | 10.1991 | 139.0 | 8618 | 11.0211 |
187
+ | 10.1991 | 140.0 | 8680 | 10.9309 |
188
+ | 10.1991 | 141.0 | 8742 | 10.9770 |
189
+ | 10.1991 | 142.0 | 8804 | 11.0791 |
190
+ | 10.1991 | 143.0 | 8866 | 11.1165 |
191
+ | 10.1991 | 144.0 | 8928 | 10.9369 |
192
+ | 10.1991 | 145.0 | 8990 | 11.1211 |
193
+ | 10.1925 | 146.0 | 9052 | 11.0745 |
194
+ | 10.1925 | 147.0 | 9114 | 11.1046 |
195
+ | 10.1925 | 148.0 | 9176 | 11.0258 |
196
+ | 10.1925 | 149.0 | 9238 | 11.0266 |
197
+ | 10.1925 | 150.0 | 9300 | 11.2540 |
198
+ | 10.1925 | 151.0 | 9362 | 10.9704 |
199
+ | 10.1925 | 152.0 | 9424 | 11.0341 |
200
+ | 10.1925 | 153.0 | 9486 | 11.1114 |
201
+ | 10.1538 | 154.0 | 9548 | 11.0224 |
202
+ | 10.1538 | 155.0 | 9610 | 10.9150 |
203
+ | 10.1538 | 156.0 | 9672 | 10.9305 |
204
+ | 10.1538 | 157.0 | 9734 | 11.0699 |
205
+ | 10.1538 | 158.0 | 9796 | 10.9901 |
206
+ | 10.1538 | 159.0 | 9858 | 11.0688 |
207
+ | 10.1538 | 160.0 | 9920 | 10.9334 |
208
+ | 10.1538 | 161.0 | 9982 | 10.9852 |
209
+ | 10.1494 | 162.0 | 10044 | 10.9032 |
210
+ | 10.1494 | 163.0 | 10106 | 10.9618 |
211
+ | 10.1494 | 164.0 | 10168 | 10.9473 |
212
+ | 10.1494 | 165.0 | 10230 | 11.1531 |
213
+ | 10.1494 | 166.0 | 10292 | 10.8462 |
214
+ | 10.1494 | 167.0 | 10354 | 10.9577 |
215
+ | 10.1494 | 168.0 | 10416 | 10.9351 |
216
+ | 10.1494 | 169.0 | 10478 | 11.2125 |
217
+ | 10.1424 | 170.0 | 10540 | 11.0546 |
218
+ | 10.1424 | 171.0 | 10602 | 10.9934 |
219
+ | 10.1424 | 172.0 | 10664 | 10.8918 |
220
+ | 10.1424 | 173.0 | 10726 | 10.8868 |
221
+ | 10.1424 | 174.0 | 10788 | 11.0400 |
222
+ | 10.1424 | 175.0 | 10850 | 11.1198 |
223
+ | 10.1424 | 176.0 | 10912 | 11.1595 |
224
+ | 10.1424 | 177.0 | 10974 | 11.1137 |
225
+ | 10.1181 | 178.0 | 11036 | 11.1998 |
226
+ | 10.1181 | 179.0 | 11098 | 11.0494 |
227
+ | 10.1181 | 180.0 | 11160 | 10.9489 |
228
+ | 10.1181 | 181.0 | 11222 | 11.0248 |
229
+ | 10.1181 | 182.0 | 11284 | 10.9912 |
230
+ | 10.1181 | 183.0 | 11346 | 10.9221 |
231
+ | 10.1181 | 184.0 | 11408 | 11.0553 |
232
+ | 10.1181 | 185.0 | 11470 | 11.0055 |
233
+ | 10.1165 | 186.0 | 11532 | 11.1129 |
234
+ | 10.1165 | 187.0 | 11594 | 11.0822 |
235
+ | 10.1165 | 188.0 | 11656 | 11.0509 |
236
+ | 10.1165 | 189.0 | 11718 | 11.0881 |
237
+ | 10.1165 | 190.0 | 11780 | 10.8909 |
238
+ | 10.1165 | 191.0 | 11842 | 11.0489 |
239
+ | 10.1165 | 192.0 | 11904 | 10.9349 |
240
+ | 10.1165 | 193.0 | 11966 | 10.8821 |
241
+ | 10.1021 | 194.0 | 12028 | 11.0552 |
242
+ | 10.1021 | 195.0 | 12090 | 11.1524 |
243
+ | 10.1021 | 196.0 | 12152 | 11.0084 |
244
+ | 10.1021 | 197.0 | 12214 | 11.0870 |
245
+ | 10.1021 | 198.0 | 12276 | 10.8429 |
246
+ | 10.1021 | 199.0 | 12338 | 11.0104 |
247
+ | 10.1021 | 200.0 | 12400 | 10.9269 |
248
+ | 10.1021 | 201.0 | 12462 | 10.9873 |
249
+ | 10.1022 | 202.0 | 12524 | 10.9878 |
250
+ | 10.1022 | 203.0 | 12586 | 10.8828 |
251
+ | 10.1022 | 204.0 | 12648 | 11.0434 |
252
+ | 10.1022 | 205.0 | 12710 | 10.9539 |
253
+ | 10.1022 | 206.0 | 12772 | 10.6848 |
254
+ | 10.1022 | 207.0 | 12834 | 11.1773 |
255
+ | 10.1022 | 208.0 | 12896 | 10.9967 |
256
+ | 10.1022 | 209.0 | 12958 | 10.9989 |
257
+ | 10.0962 | 210.0 | 13020 | 11.2001 |
258
+ | 10.0962 | 211.0 | 13082 | 10.9658 |
259
+ | 10.0962 | 212.0 | 13144 | 11.0099 |
260
+ | 10.0962 | 213.0 | 13206 | 11.0534 |
261
+ | 10.0962 | 214.0 | 13268 | 11.1858 |
262
+ | 10.0962 | 215.0 | 13330 | 11.0441 |
263
+ | 10.0962 | 216.0 | 13392 | 11.1819 |
264
+ | 10.0962 | 217.0 | 13454 | 11.0100 |
265
+ | 10.0861 | 218.0 | 13516 | 11.0071 |
266
+ | 10.0861 | 219.0 | 13578 | 11.1453 |
267
+ | 10.0861 | 220.0 | 13640 | 10.9854 |
268
+ | 10.0861 | 221.0 | 13702 | 11.1206 |
269
+ | 10.0861 | 222.0 | 13764 | 11.0695 |
270
+ | 10.0861 | 223.0 | 13826 | 11.0700 |
271
+ | 10.0861 | 224.0 | 13888 | 10.9683 |
272
+ | 10.0861 | 225.0 | 13950 | 10.9319 |
273
+ | 10.0808 | 226.0 | 14012 | 10.9934 |
274
+ | 10.0808 | 227.0 | 14074 | 10.8787 |
275
+ | 10.0808 | 228.0 | 14136 | 10.9051 |
276
+ | 10.0808 | 229.0 | 14198 | 11.0375 |
277
+ | 10.0808 | 230.0 | 14260 | 11.0259 |
278
+ | 10.0808 | 231.0 | 14322 | 11.0635 |
279
+ | 10.0808 | 232.0 | 14384 | 10.8822 |
280
+ | 10.0808 | 233.0 | 14446 | 10.8910 |
281
+ | 10.0768 | 234.0 | 14508 | 10.9744 |
282
+ | 10.0768 | 235.0 | 14570 | 11.0422 |
283
+ | 10.0768 | 236.0 | 14632 | 11.0398 |
284
+ | 10.0768 | 237.0 | 14694 | 10.8507 |
285
+ | 10.0768 | 238.0 | 14756 | 11.0227 |
286
+ | 10.0768 | 239.0 | 14818 | 11.0273 |
287
+ | 10.0768 | 240.0 | 14880 | 11.0778 |
288
+ | 10.0768 | 241.0 | 14942 | 11.0777 |
289
+ | 10.0792 | 242.0 | 15004 | 10.9423 |
290
+ | 10.0792 | 243.0 | 15066 | 11.2267 |
291
+ | 10.0792 | 244.0 | 15128 | 10.8529 |
292
+ | 10.0792 | 245.0 | 15190 | 11.0566 |
293
+ | 10.0792 | 246.0 | 15252 | 10.8876 |
294
+ | 10.0792 | 247.0 | 15314 | 11.1441 |
295
+ | 10.0792 | 248.0 | 15376 | 10.9090 |
296
+ | 10.0792 | 249.0 | 15438 | 10.9756 |
297
+ | 10.0832 | 250.0 | 15500 | 10.9538 |
298
+ | 10.0832 | 251.0 | 15562 | 10.8424 |
299
+ | 10.0832 | 252.0 | 15624 | 10.7671 |
300
+ | 10.0832 | 253.0 | 15686 | 10.9635 |
301
+ | 10.0832 | 254.0 | 15748 | 10.8490 |
302
+ | 10.0832 | 255.0 | 15810 | 11.1349 |
303
+ | 10.0832 | 256.0 | 15872 | 10.8844 |
304
+ | 10.0832 | 257.0 | 15934 | 10.8656 |
305
+ | 10.0832 | 258.0 | 15996 | 10.8234 |
306
+ | 10.0747 | 259.0 | 16058 | 10.9503 |
307
+ | 10.0747 | 260.0 | 16120 | 10.8856 |
308
+ | 10.0747 | 261.0 | 16182 | 11.0519 |
309
+ | 10.0747 | 262.0 | 16244 | 10.8862 |
310
+ | 10.0747 | 263.0 | 16306 | 10.8974 |
311
+ | 10.0747 | 264.0 | 16368 | 10.8464 |
312
+ | 10.0747 | 265.0 | 16430 | 10.9659 |
313
+ | 10.0747 | 266.0 | 16492 | 10.7426 |
314
+ | 10.0678 | 267.0 | 16554 | 10.9852 |
315
+ | 10.0678 | 268.0 | 16616 | 11.0498 |
316
+ | 10.0678 | 269.0 | 16678 | 10.7894 |
317
+ | 10.0678 | 270.0 | 16740 | 11.1073 |
318
+ | 10.0678 | 271.0 | 16802 | 10.8264 |
319
+ | 10.0678 | 272.0 | 16864 | 10.9315 |
320
+ | 10.0678 | 273.0 | 16926 | 10.7760 |
321
+ | 10.0678 | 274.0 | 16988 | 10.9723 |
322
+ | 10.0631 | 275.0 | 17050 | 10.7482 |
323
+ | 10.0631 | 276.0 | 17112 | 11.0491 |
324
+ | 10.0631 | 277.0 | 17174 | 10.7516 |
325
+ | 10.0631 | 278.0 | 17236 | 10.9505 |
326
+ | 10.0631 | 279.0 | 17298 | 10.8899 |
327
+ | 10.0631 | 280.0 | 17360 | 10.7864 |
328
+ | 10.0631 | 281.0 | 17422 | 10.8660 |
329
+ | 10.0631 | 282.0 | 17484 | 10.9755 |
330
+ | 10.0464 | 283.0 | 17546 | 10.9702 |
331
+ | 10.0464 | 284.0 | 17608 | 10.9664 |
332
+ | 10.0464 | 285.0 | 17670 | 10.9413 |
333
+ | 10.0464 | 286.0 | 17732 | 10.9662 |
334
+ | 10.0464 | 287.0 | 17794 | 10.9511 |
335
+ | 10.0464 | 288.0 | 17856 | 10.8648 |
336
+ | 10.0464 | 289.0 | 17918 | 10.8867 |
337
+ | 10.0464 | 290.0 | 17980 | 11.0379 |
338
+ | 10.059 | 291.0 | 18042 | 10.9587 |
339
+ | 10.059 | 292.0 | 18104 | 10.8715 |
340
+ | 10.059 | 293.0 | 18166 | 11.0329 |
341
+ | 10.059 | 294.0 | 18228 | 10.9934 |
342
+ | 10.059 | 295.0 | 18290 | 11.0318 |
343
+ | 10.059 | 296.0 | 18352 | 10.9496 |
344
+ | 10.059 | 297.0 | 18414 | 10.9851 |
345
+ | 10.059 | 298.0 | 18476 | 10.9042 |
346
+ | 10.0478 | 299.0 | 18538 | 10.8483 |
347
+ | 10.0478 | 300.0 | 18600 | 11.1284 |
348
+ | 10.0478 | 301.0 | 18662 | 10.9656 |
349
+ | 10.0478 | 302.0 | 18724 | 10.9622 |
350
+ | 10.0478 | 303.0 | 18786 | 11.0226 |
351
+ | 10.0478 | 304.0 | 18848 | 10.9982 |
352
+ | 10.0478 | 305.0 | 18910 | 10.9646 |
353
+ | 10.0478 | 306.0 | 18972 | 11.0949 |
354
+ | 10.0513 | 307.0 | 19034 | 11.0740 |
355
+ | 10.0513 | 308.0 | 19096 | 10.8888 |
356
+ | 10.0513 | 309.0 | 19158 | 11.2476 |
357
+ | 10.0513 | 310.0 | 19220 | 10.9996 |
358
+ | 10.0513 | 311.0 | 19282 | 10.8044 |
359
+ | 10.0513 | 312.0 | 19344 | 10.9493 |
360
+ | 10.0513 | 313.0 | 19406 | 10.9460 |
361
+ | 10.0513 | 314.0 | 19468 | 10.9664 |
362
+ | 10.0363 | 315.0 | 19530 | 10.9196 |
363
+ | 10.0363 | 316.0 | 19592 | 10.9218 |
364
+ | 10.0363 | 317.0 | 19654 | 10.8009 |
365
+ | 10.0363 | 318.0 | 19716 | 11.1215 |
366
+ | 10.0363 | 319.0 | 19778 | 10.9651 |
367
+ | 10.0363 | 320.0 | 19840 | 10.9957 |
368
+ | 10.0363 | 321.0 | 19902 | 11.1449 |
369
+ | 10.0363 | 322.0 | 19964 | 11.0132 |
370
+ | 10.0503 | 323.0 | 20026 | 11.1194 |
371
+ | 10.0503 | 324.0 | 20088 | 10.9650 |
372
+ | 10.0503 | 325.0 | 20150 | 10.8414 |
373
+ | 10.0503 | 326.0 | 20212 | 10.8668 |
374
+ | 10.0503 | 327.0 | 20274 | 11.0100 |
375
+ | 10.0503 | 328.0 | 20336 | 10.8759 |
376
+ | 10.0503 | 329.0 | 20398 | 10.9656 |
377
+ | 10.0503 | 330.0 | 20460 | 11.0078 |
378
+ | 10.0223 | 331.0 | 20522 | 11.0198 |
379
+ | 10.0223 | 332.0 | 20584 | 11.0888 |
380
+ | 10.0223 | 333.0 | 20646 | 11.1058 |
381
+ | 10.0223 | 334.0 | 20708 | 10.9423 |
382
+ | 10.0223 | 335.0 | 20770 | 11.1030 |
383
+ | 10.0223 | 336.0 | 20832 | 11.0819 |
384
+ | 10.0223 | 337.0 | 20894 | 10.9060 |
385
+ | 10.0223 | 338.0 | 20956 | 11.0750 |
386
+ | 10.0321 | 339.0 | 21018 | 11.1101 |
387
+ | 10.0321 | 340.0 | 21080 | 10.9711 |
388
+ | 10.0321 | 341.0 | 21142 | 10.9287 |
389
+ | 10.0321 | 342.0 | 21204 | 10.7962 |
390
+ | 10.0321 | 343.0 | 21266 | 11.1362 |
391
+ | 10.0321 | 344.0 | 21328 | 11.1022 |
392
+ | 10.0321 | 345.0 | 21390 | 10.9997 |
393
+ | 10.0321 | 346.0 | 21452 | 10.8761 |
394
+ | 10.0226 | 347.0 | 21514 | 10.9343 |
395
+ | 10.0226 | 348.0 | 21576 | 10.9110 |
396
+ | 10.0226 | 349.0 | 21638 | 11.0345 |
397
+ | 10.0226 | 350.0 | 21700 | 10.8872 |
398
+ | 10.0226 | 351.0 | 21762 | 10.7667 |
399
+ | 10.0226 | 352.0 | 21824 | 11.0568 |
400
+ | 10.0226 | 353.0 | 21886 | 11.0288 |
401
+ | 10.0226 | 354.0 | 21948 | 11.0664 |
402
+ | 10.033 | 355.0 | 22010 | 10.9751 |
403
+ | 10.033 | 356.0 | 22072 | 10.8561 |
404
+ | 10.033 | 357.0 | 22134 | 10.9609 |
405
+ | 10.033 | 358.0 | 22196 | 11.0002 |
406
+ | 10.033 | 359.0 | 22258 | 11.0568 |
407
+ | 10.033 | 360.0 | 22320 | 10.9586 |
408
+ | 10.033 | 361.0 | 22382 | 10.9254 |
409
+ | 10.033 | 362.0 | 22444 | 11.0652 |
410
+ | 10.0084 | 363.0 | 22506 | 10.9656 |
411
+ | 10.0084 | 364.0 | 22568 | 11.0611 |
412
+ | 10.0084 | 365.0 | 22630 | 10.8335 |
413
+ | 10.0084 | 366.0 | 22692 | 10.9809 |
414
+ | 10.0084 | 367.0 | 22754 | 11.0209 |
415
+ | 10.0084 | 368.0 | 22816 | 10.9149 |
416
+ | 10.0084 | 369.0 | 22878 | 11.0207 |
417
+ | 10.0084 | 370.0 | 22940 | 10.8774 |
418
+ | 10.024 | 371.0 | 23002 | 10.9855 |
419
+ | 10.024 | 372.0 | 23064 | 10.9064 |
420
+ | 10.024 | 373.0 | 23126 | 10.9518 |
421
+ | 10.024 | 374.0 | 23188 | 10.8775 |
422
+ | 10.024 | 375.0 | 23250 | 10.9193 |
423
+ | 10.024 | 376.0 | 23312 | 11.1098 |
424
+ | 10.024 | 377.0 | 23374 | 11.1486 |
425
+ | 10.024 | 378.0 | 23436 | 11.0895 |
426
+ | 10.024 | 379.0 | 23498 | 10.9159 |
427
+ | 10.0052 | 380.0 | 23560 | 11.1095 |
428
+ | 10.0052 | 381.0 | 23622 | 11.0949 |
429
+ | 10.0052 | 382.0 | 23684 | 10.9837 |
430
+ | 10.0052 | 383.0 | 23746 | 10.9433 |
431
+ | 10.0052 | 384.0 | 23808 | 10.9104 |
432
+ | 10.0052 | 385.0 | 23870 | 10.9512 |
433
+ | 10.0052 | 386.0 | 23932 | 11.1075 |
434
+ | 10.0052 | 387.0 | 23994 | 10.8660 |
435
+ | 10.0218 | 388.0 | 24056 | 11.0521 |
436
+ | 10.0218 | 389.0 | 24118 | 10.8989 |
437
+ | 10.0218 | 390.0 | 24180 | 10.9139 |
438
+ | 10.0218 | 391.0 | 24242 | 11.1079 |
439
+ | 10.0218 | 392.0 | 24304 | 10.9063 |
440
+ | 10.0218 | 393.0 | 24366 | 11.0851 |
441
+ | 10.0218 | 394.0 | 24428 | 10.9809 |
442
+ | 10.0218 | 395.0 | 24490 | 10.9320 |
443
+ | 10.0039 | 396.0 | 24552 | 11.0525 |
444
+ | 10.0039 | 397.0 | 24614 | 11.0378 |
445
+ | 10.0039 | 398.0 | 24676 | 11.0006 |
446
+ | 10.0039 | 399.0 | 24738 | 11.0284 |
447
+ | 10.0039 | 400.0 | 24800 | 11.0055 |
448
+ | 10.0039 | 401.0 | 24862 | 11.0104 |
449
+ | 10.0039 | 402.0 | 24924 | 11.1168 |
450
+ | 10.0039 | 403.0 | 24986 | 10.8311 |
451
+ | 10.0186 | 404.0 | 25048 | 10.8904 |
452
+ | 10.0186 | 405.0 | 25110 | 10.8615 |
453
+ | 10.0186 | 406.0 | 25172 | 10.9520 |
454
+ | 10.0186 | 407.0 | 25234 | 10.9112 |
455
+ | 10.0186 | 408.0 | 25296 | 11.0280 |
456
+ | 10.0186 | 409.0 | 25358 | 10.8281 |
457
+ | 10.0186 | 410.0 | 25420 | 11.1875 |
458
+ | 10.0186 | 411.0 | 25482 | 11.0089 |
459
+ | 10.0146 | 412.0 | 25544 | 11.0386 |
460
+ | 10.0146 | 413.0 | 25606 | 10.8152 |
461
+ | 10.0146 | 414.0 | 25668 | 10.9460 |
462
+ | 10.0146 | 415.0 | 25730 | 10.9922 |
463
+ | 10.0146 | 416.0 | 25792 | 11.0850 |
464
+ | 10.0146 | 417.0 | 25854 | 11.0024 |
465
+ | 10.0146 | 418.0 | 25916 | 11.0934 |
466
+ | 10.0146 | 419.0 | 25978 | 11.0953 |
467
+ | 10.0251 | 420.0 | 26040 | 10.8996 |
468
+ | 10.0251 | 421.0 | 26102 | 10.9833 |
469
+ | 10.0251 | 422.0 | 26164 | 10.7546 |
470
+ | 10.0251 | 423.0 | 26226 | 10.9770 |
471
+ | 10.0251 | 424.0 | 26288 | 11.0632 |
472
+ | 10.0251 | 425.0 | 26350 | 10.9244 |
473
+ | 10.0251 | 426.0 | 26412 | 10.9376 |
474
+ | 10.0251 | 427.0 | 26474 | 11.0441 |
475
+ | 9.9776 | 428.0 | 26536 | 11.0679 |
476
+ | 9.9776 | 429.0 | 26598 | 11.0663 |
477
+ | 9.9776 | 430.0 | 26660 | 10.9885 |
478
+ | 9.9776 | 431.0 | 26722 | 10.9566 |
479
+ | 9.9776 | 432.0 | 26784 | 11.1560 |
480
+ | 9.9776 | 433.0 | 26846 | 11.0590 |
481
+ | 9.9776 | 434.0 | 26908 | 11.0154 |
482
+ | 9.9776 | 435.0 | 26970 | 10.9648 |
483
+ | 10.0079 | 436.0 | 27032 | 11.0840 |
484
+ | 10.0079 | 437.0 | 27094 | 10.8103 |
485
+ | 10.0079 | 438.0 | 27156 | 10.8994 |
486
+ | 10.0079 | 439.0 | 27218 | 11.0360 |
487
+ | 10.0079 | 440.0 | 27280 | 10.9094 |
488
+ | 10.0079 | 441.0 | 27342 | 10.9402 |
489
+ | 10.0079 | 442.0 | 27404 | 10.8771 |
490
+ | 10.0079 | 443.0 | 27466 | 11.0934 |
491
+ | 10.0049 | 444.0 | 27528 | 11.0897 |
492
+ | 10.0049 | 445.0 | 27590 | 11.0493 |
493
+ | 10.0049 | 446.0 | 27652 | 11.0395 |
494
+ | 10.0049 | 447.0 | 27714 | 10.8990 |
495
+ | 10.0049 | 448.0 | 27776 | 11.1673 |
496
+ | 10.0049 | 449.0 | 27838 | 11.1582 |
497
+ | 10.0049 | 450.0 | 27900 | 10.8591 |
498
+ | 10.0049 | 451.0 | 27962 | 11.0792 |
499
+ | 9.9924 | 452.0 | 28024 | 11.1450 |
500
+ | 9.9924 | 453.0 | 28086 | 10.9819 |
501
+ | 9.9924 | 454.0 | 28148 | 10.8871 |
502
+ | 9.9924 | 455.0 | 28210 | 10.9915 |
503
+ | 9.9924 | 456.0 | 28272 | 11.0373 |
504
+ | 9.9924 | 457.0 | 28334 | 10.9383 |
505
+ | 9.9924 | 458.0 | 28396 | 11.1292 |
506
+ | 9.9924 | 459.0 | 28458 | 11.1688 |
507
+ | 9.9918 | 460.0 | 28520 | 11.0430 |
508
+ | 9.9918 | 461.0 | 28582 | 11.0710 |
509
+ | 9.9918 | 462.0 | 28644 | 11.0110 |
510
+ | 9.9918 | 463.0 | 28706 | 11.0876 |
511
+ | 9.9918 | 464.0 | 28768 | 11.0982 |
512
+ | 9.9918 | 465.0 | 28830 | 10.9625 |
513
+ | 9.9918 | 466.0 | 28892 | 10.9642 |
514
+ | 9.9918 | 467.0 | 28954 | 10.7989 |
515
+ | 9.9799 | 468.0 | 29016 | 11.0038 |
516
+ | 9.9799 | 469.0 | 29078 | 11.1245 |
517
+ | 9.9799 | 470.0 | 29140 | 10.9135 |
518
+ | 9.9799 | 471.0 | 29202 | 10.9432 |
519
+ | 9.9799 | 472.0 | 29264 | 10.8295 |
520
+ | 9.9799 | 473.0 | 29326 | 10.9277 |
521
+ | 9.9799 | 474.0 | 29388 | 11.0949 |
522
+ | 9.9799 | 475.0 | 29450 | 11.0374 |
523
+ | 9.9961 | 476.0 | 29512 | 10.9588 |
524
+ | 9.9961 | 477.0 | 29574 | 11.0341 |
525
+ | 9.9961 | 478.0 | 29636 | 10.9541 |
526
+ | 9.9961 | 479.0 | 29698 | 10.9343 |
527
+ | 9.9961 | 480.0 | 29760 | 10.9599 |
528
+ | 9.9961 | 481.0 | 29822 | 10.9533 |
529
+ | 9.9961 | 482.0 | 29884 | 11.2046 |
530
+ | 9.9961 | 483.0 | 29946 | 10.9352 |
531
+ | 10.006 | 484.0 | 30008 | 11.1727 |
532
+ | 10.006 | 485.0 | 30070 | 10.9956 |
533
+ | 10.006 | 486.0 | 30132 | 11.1664 |
534
+ | 10.006 | 487.0 | 30194 | 11.0949 |
535
+ | 10.006 | 488.0 | 30256 | 10.9489 |
536
+ | 10.006 | 489.0 | 30318 | 11.0049 |
537
+ | 10.006 | 490.0 | 30380 | 11.1852 |
538
+ | 10.006 | 491.0 | 30442 | 11.1018 |
539
+ | 10.0083 | 492.0 | 30504 | 10.9130 |
540
+ | 10.0083 | 493.0 | 30566 | 10.9352 |
541
+ | 10.0083 | 494.0 | 30628 | 10.9716 |
542
+ | 10.0083 | 495.0 | 30690 | 11.1115 |
543
+ | 10.0083 | 496.0 | 30752 | 10.9810 |
544
+ | 10.0083 | 497.0 | 30814 | 10.9703 |
545
+ | 10.0083 | 498.0 | 30876 | 10.9395 |
546
+ | 10.0083 | 499.0 | 30938 | 11.0189 |
547
+ | 10.0106 | 500.0 | 31000 | 10.9759 |
548
 
549
 
550
  ### Framework versions
551
 
552
+ - Transformers 4.20.1
553
+ - Pytorch 1.11.0
554
+ - Datasets 2.1.0
555
  - Tokenizers 0.12.1