File size: 34,581 Bytes
93ad1f2
 
4561dd5
93ad1f2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
---

base_model: microsoft/conditional-detr-resnet-50
license: apache-2.0
tags:
- generated_from_trainer
model-index:
- name: vehicle_detection
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# vehicle_detection



This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the None dataset.

It achieves the following results on the evaluation set:

- Loss: 0.2233

- Map: 0.9186

- Map 50: 0.9888

- Map 75: 0.9702

- Map Small: 0.0168

- Map Medium: 0.8326

- Map Large: 0.9267

- Mar 1: 0.39

- Mar 10: 0.9118

- Mar 100: 0.9461

- Mar Small: 0.0167

- Mar Medium: 0.883

- Mar Large: 0.953

- Map Car: 0.9208

- Mar 100 Car: 0.9447

- Map Twowheeler: 0.9227

- Mar 100 Twowheeler: 0.9476

- Map Auto: 0.8797

- Mar 100 Auto: 0.9232

- Map Bus: 0.93

- Mar 100 Bus: 0.9552

- Map Truck: 0.94

- Mar 100 Truck: 0.9599



## Model description



More information needed



## Intended uses & limitations



More information needed



## Training and evaluation data



More information needed



## Training procedure



### Training hyperparameters



The following hyperparameters were used during training:

- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 100

- mixed_precision_training: Native AMP



### Training results



| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Car | Mar 100 Car | Map Twowheeler | Mar 100 Twowheeler | Map Auto | Mar 100 Auto | Map Bus | Mar 100 Bus | Map Truck | Mar 100 Truck |

|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-------:|:-----------:|:--------------:|:------------------:|:--------:|:------------:|:-------:|:-----------:|:---------:|:-------------:|

| No log        | 1.0   | 229   | 1.9856          | 0.0192 | 0.0426 | 0.0169 | 0.0       | 0.0005     | 0.0205    | 0.0089 | 0.0398 | 0.106   | 0.0       | 0.0074     | 0.1124    | 0.0947  | 0.5102      | 0.0015         | 0.02               | 0.0      | 0.0          | 0.0     | 0.0         | 0.0       | 0.0           |

| No log        | 2.0   | 458   | 1.6568          | 0.0551 | 0.1059 | 0.0545 | 0.0       | 0.0483     | 0.056     | 0.0427 | 0.1326 | 0.2109  | 0.0       | 0.1499     | 0.2097    | 0.1798  | 0.6435      | 0.0178         | 0.1473             | 0.0686   | 0.1522       | 0.0007  | 0.0325      | 0.0088    | 0.0787        |

| 3.2288        | 3.0   | 687   | 1.5186          | 0.1102 | 0.1976 | 0.1134 | 0.0       | 0.0914     | 0.1095    | 0.0734 | 0.238  | 0.3274  | 0.0       | 0.1826     | 0.3338    | 0.2763  | 0.6943      | 0.1158         | 0.4139             | 0.1317   | 0.271        | 0.0226  | 0.119       | 0.0046    | 0.1386        |

| 3.2288        | 4.0   | 916   | 1.3361          | 0.1499 | 0.2474 | 0.1617 | 0.0       | 0.1175     | 0.1508    | 0.0948 | 0.3171 | 0.4177  | 0.0       | 0.2566     | 0.4266    | 0.3726  | 0.7412      | 0.1597         | 0.579              | 0.1768   | 0.3913       | 0.0275  | 0.1867      | 0.0129    | 0.1906        |

| 1.4282        | 5.0   | 1145  | 1.2549          | 0.1958 | 0.326  | 0.2123 | 0.0       | 0.1189     | 0.2027    | 0.1253 | 0.4038 | 0.5086  | 0.0       | 0.2705     | 0.5279    | 0.4481  | 0.7446      | 0.2302         | 0.6364             | 0.1981   | 0.4741       | 0.0537  | 0.3586      | 0.0488    | 0.3292        |

| 1.4282        | 6.0   | 1374  | 1.1393          | 0.2589 | 0.398  | 0.2816 | 0.0       | 0.2273     | 0.2586    | 0.1605 | 0.5096 | 0.6228  | 0.0       | 0.4519     | 0.6371    | 0.5211  | 0.7628      | 0.3211         | 0.7083             | 0.2883   | 0.6504       | 0.0848  | 0.4807      | 0.0793    | 0.5119        |

| 1.172         | 7.0   | 1603  | 1.0888          | 0.3236 | 0.4901 | 0.3573 | 0.0       | 0.3587     | 0.3187    | 0.1885 | 0.5581 | 0.6591  | 0.0       | 0.5986     | 0.6641    | 0.5699  | 0.7709      | 0.393          | 0.7138             | 0.3439   | 0.661        | 0.1689  | 0.5467      | 0.1424    | 0.6031        |

| 1.172         | 8.0   | 1832  | 0.9997          | 0.3794 | 0.5421 | 0.4216 | 0.0       | 0.3792     | 0.3785    | 0.2154 | 0.6143 | 0.7034  | 0.0       | 0.6357     | 0.7102    | 0.6207  | 0.7971      | 0.47           | 0.7611             | 0.4082   | 0.6813       | 0.2144  | 0.6463      | 0.1835    | 0.6314        |

| 1.0361        | 9.0   | 2061  | 0.9796          | 0.424  | 0.6006 | 0.4761 | 0.0114    | 0.3865     | 0.43      | 0.2416 | 0.6314 | 0.717   | 0.0333    | 0.5976     | 0.7297    | 0.6461  | 0.7925      | 0.5229         | 0.7637             | 0.3866   | 0.6755       | 0.2786  | 0.6679      | 0.2857    | 0.6855        |

| 1.0361        | 10.0  | 2290  | 0.8782          | 0.5167 | 0.6937 | 0.5831 | 0.0       | 0.4704     | 0.524     | 0.2729 | 0.6941 | 0.7711  | 0.0       | 0.6556     | 0.7819    | 0.6851  | 0.8177      | 0.5872         | 0.7896             | 0.4967   | 0.7474       | 0.374   | 0.6988      | 0.4407    | 0.8018        |

| 0.9095        | 11.0  | 2519  | 0.8567          | 0.5329 | 0.7133 | 0.6079 | 0.0       | 0.4845     | 0.5393    | 0.2805 | 0.6993 | 0.773   | 0.0       | 0.6472     | 0.7856    | 0.6822  | 0.8049      | 0.599          | 0.7895             | 0.5309   | 0.7533       | 0.3702  | 0.7294      | 0.4825    | 0.7877        |

| 0.9095        | 12.0  | 2748  | 0.8288          | 0.5647 | 0.7448 | 0.6448 | 0.1347    | 0.489      | 0.5734    | 0.2862 | 0.7164 | 0.7853  | 0.1333    | 0.6483     | 0.7975    | 0.6904  | 0.8157      | 0.6037         | 0.7808             | 0.5581   | 0.7641       | 0.4403  | 0.7539      | 0.5308    | 0.8118        |

| 0.9095        | 13.0  | 2977  | 0.7847          | 0.5902 | 0.7746 | 0.674  | 0.0       | 0.5372     | 0.5951    | 0.2964 | 0.7264 | 0.7867  | 0.0       | 0.6727     | 0.7978    | 0.7096  | 0.8184      | 0.6454         | 0.8043             | 0.5636   | 0.7631       | 0.4959  | 0.7512      | 0.5364    | 0.7963        |

| 0.8129        | 14.0  | 3206  | 0.7430          | 0.6291 | 0.8117 | 0.7151 | 0.0       | 0.5248     | 0.6378    | 0.3103 | 0.7454 | 0.801   | 0.0       | 0.6606     | 0.8146    | 0.7295  | 0.8314      | 0.6656         | 0.8225             | 0.6015   | 0.7824       | 0.5479  | 0.7588      | 0.6009    | 0.81          |

| 0.8129        | 15.0  | 3435  | 0.7187          | 0.6398 | 0.8242 | 0.737  | 0.0       | 0.5326     | 0.6482    | 0.3083 | 0.7487 | 0.8027  | 0.0       | 0.672      | 0.8135    | 0.7392  | 0.8356      | 0.6817         | 0.8242             | 0.6307   | 0.7929       | 0.5222  | 0.7398      | 0.6251    | 0.821         |

| 0.748         | 16.0  | 3664  | 0.7008          | 0.6486 | 0.83   | 0.735  | 0.0       | 0.5434     | 0.6576    | 0.3076 | 0.7524 | 0.8049  | 0.0       | 0.6797     | 0.8164    | 0.7529  | 0.844       | 0.6859         | 0.8224             | 0.6329   | 0.7932       | 0.5457  | 0.7446      | 0.6255    | 0.8203        |

| 0.748         | 17.0  | 3893  | 0.7042          | 0.6523 | 0.8462 | 0.7542 | 0.0       | 0.5646     | 0.6612    | 0.3162 | 0.7525 | 0.806   | 0.0       | 0.679      | 0.8181    | 0.7367  | 0.826       | 0.6755         | 0.804              | 0.6157   | 0.7821       | 0.5825  | 0.788       | 0.651     | 0.83          |

| 0.6979        | 18.0  | 4122  | 0.6434          | 0.6987 | 0.8684 | 0.7936 | 0.0       | 0.5947     | 0.7073    | 0.3282 | 0.7857 | 0.8348  | 0.0       | 0.7175     | 0.8469    | 0.7767  | 0.8561      | 0.7213         | 0.8463             | 0.6801   | 0.8165       | 0.643   | 0.8022      | 0.6722    | 0.8529        |

| 0.6979        | 19.0  | 4351  | 0.6231          | 0.7049 | 0.8806 | 0.8131 | 0.0       | 0.607      | 0.7131    | 0.3297 | 0.7819 | 0.827   | 0.0       | 0.7175     | 0.8374    | 0.761   | 0.8424      | 0.7167         | 0.8383             | 0.7004   | 0.82         | 0.6527  | 0.7882      | 0.6936    | 0.8461        |

| 0.6589        | 20.0  | 4580  | 0.6284          | 0.7074 | 0.8836 | 0.8081 | 0.0       | 0.6173     | 0.7146    | 0.3324 | 0.785  | 0.8311  | 0.0       | 0.7258     | 0.8409    | 0.7747  | 0.8543      | 0.7168         | 0.8345             | 0.6881   | 0.8136       | 0.6575  | 0.8058      | 0.6997    | 0.8474        |

| 0.6589        | 21.0  | 4809  | 0.5998          | 0.7205 | 0.8955 | 0.8187 | 0.0       | 0.6133     | 0.7302    | 0.3325 | 0.7944 | 0.8427  | 0.0       | 0.7266     | 0.8543    | 0.7821  | 0.8565      | 0.7414         | 0.8484             | 0.6888   | 0.8175       | 0.6778  | 0.83        | 0.7125    | 0.861         |

| 0.6182        | 22.0  | 5038  | 0.6040          | 0.7196 | 0.888  | 0.8178 | 0.0       | 0.6161     | 0.7304    | 0.3288 | 0.7937 | 0.8427  | 0.0       | 0.7385     | 0.8538    | 0.7863  | 0.8609      | 0.745          | 0.8573             | 0.6975   | 0.8247       | 0.6467  | 0.8147      | 0.7227    | 0.8561        |

| 0.6182        | 23.0  | 5267  | 0.5959          | 0.7329 | 0.8994 | 0.8317 | 0.0       | 0.6189     | 0.7412    | 0.338  | 0.8018 | 0.8459  | 0.0       | 0.7299     | 0.8566    | 0.7921  | 0.864       | 0.7467         | 0.8585             | 0.7291   | 0.8403       | 0.6852  | 0.8164      | 0.7114    | 0.8506        |

| 0.6182        | 24.0  | 5496  | 0.5712          | 0.7374 | 0.9106 | 0.8392 | 0.0038    | 0.649      | 0.744     | 0.3395 | 0.802  | 0.8487  | 0.0583    | 0.7426     | 0.8587    | 0.7918  | 0.8633      | 0.7476         | 0.8527             | 0.7115   | 0.8233       | 0.6865  | 0.8282      | 0.7499    | 0.8761        |

| 0.6034        | 25.0  | 5725  | 0.5547          | 0.7488 | 0.9191 | 0.8456 | 0.0       | 0.6335     | 0.7602    | 0.3434 | 0.8077 | 0.8548  | 0.0       | 0.7327     | 0.8675    | 0.804   | 0.8697      | 0.7675         | 0.8616             | 0.7157   | 0.8413       | 0.722   | 0.847       | 0.7349    | 0.8542        |

| 0.6034        | 26.0  | 5954  | 0.5622          | 0.7466 | 0.9177 | 0.8593 | 0.0       | 0.62       | 0.7598    | 0.3441 | 0.8036 | 0.8473  | 0.0       | 0.7238     | 0.8588    | 0.7931  | 0.8637      | 0.749          | 0.8513             | 0.7233   | 0.8337       | 0.7156  | 0.822       | 0.7522    | 0.8657        |

| 0.5794        | 27.0  | 6183  | 0.5197          | 0.7662 | 0.9283 | 0.8704 | 0.0       | 0.6591     | 0.7743    | 0.3468 | 0.8152 | 0.8566  | 0.0       | 0.7497     | 0.8669    | 0.8087  | 0.8741      | 0.7721         | 0.8659             | 0.7519   | 0.8431       | 0.7331  | 0.8313      | 0.7652    | 0.8685        |

| 0.5794        | 28.0  | 6412  | 0.5260          | 0.7729 | 0.9325 | 0.8779 | 0.0       | 0.6734     | 0.7813    | 0.345  | 0.8214 | 0.866   | 0.0       | 0.7614     | 0.8768    | 0.8157  | 0.8773      | 0.773          | 0.8663             | 0.7612   | 0.8542       | 0.7359  | 0.8431      | 0.7787    | 0.889         |

| 0.5511        | 29.0  | 6641  | 0.5145          | 0.7624 | 0.9301 | 0.8628 | 0.0       | 0.6492     | 0.7709    | 0.3447 | 0.8096 | 0.8564  | 0.0       | 0.7421     | 0.8666    | 0.814   | 0.8736      | 0.7687         | 0.8607             | 0.7453   | 0.8426       | 0.725   | 0.8448      | 0.7592    | 0.8604        |

| 0.5511        | 30.0  | 6870  | 0.4996          | 0.7762 | 0.9407 | 0.8836 | 0.0257    | 0.6791     | 0.7816    | 0.3488 | 0.8238 | 0.8656  | 0.025     | 0.7691     | 0.8748    | 0.8188  | 0.8773      | 0.7721         | 0.8684             | 0.7494   | 0.8428       | 0.7624  | 0.8633      | 0.7785    | 0.8761        |

| 0.5377        | 31.0  | 7099  | 0.4853          | 0.7911 | 0.946  | 0.9015 | 0.0       | 0.6981     | 0.7972    | 0.3546 | 0.8273 | 0.8692  | 0.0       | 0.7815     | 0.8762    | 0.8236  | 0.8826      | 0.8004         | 0.8762             | 0.7789   | 0.8565       | 0.765   | 0.8597      | 0.7875    | 0.8709        |

| 0.5377        | 32.0  | 7328  | 0.4858          | 0.7869 | 0.941  | 0.8932 | 0.0       | 0.679      | 0.7969    | 0.3508 | 0.8262 | 0.8699  | 0.0       | 0.7711     | 0.8803    | 0.8251  | 0.8822      | 0.7992         | 0.8823             | 0.7576   | 0.8489       | 0.7519  | 0.8444      | 0.8006    | 0.8919        |

| 0.5134        | 33.0  | 7557  | 0.4781          | 0.7857 | 0.944  | 0.9    | 0.0       | 0.6941     | 0.794     | 0.3543 | 0.8231 | 0.8641  | 0.0       | 0.7822     | 0.8715    | 0.8221  | 0.8807      | 0.8036         | 0.8794             | 0.7642   | 0.8548       | 0.7576  | 0.8364      | 0.781     | 0.8691        |

| 0.5134        | 34.0  | 7786  | 0.4783          | 0.7923 | 0.9472 | 0.8978 | 0.0       | 0.677      | 0.8006    | 0.3537 | 0.8316 | 0.8722  | 0.0       | 0.7665     | 0.8818    | 0.8281  | 0.8854      | 0.8027         | 0.8829             | 0.7795   | 0.8617       | 0.7501  | 0.8466      | 0.8014    | 0.8842        |

| 0.5006        | 35.0  | 8015  | 0.4689          | 0.7943 | 0.9499 | 0.9028 | 0.0101    | 0.6986     | 0.8017    | 0.3551 | 0.8301 | 0.8698  | 0.05      | 0.7826     | 0.8783    | 0.8285  | 0.8846      | 0.8059         | 0.8816             | 0.7777   | 0.8613       | 0.7632  | 0.8477      | 0.7961    | 0.8735        |

| 0.5006        | 36.0  | 8244  | 0.4788          | 0.794  | 0.9477 | 0.9019 | 0.0       | 0.708      | 0.8004    | 0.3539 | 0.8292 | 0.8694  | 0.0       | 0.7749     | 0.8778    | 0.827   | 0.8839      | 0.8069         | 0.8811             | 0.7793   | 0.8541       | 0.7679  | 0.8477      | 0.7888    | 0.8803        |

| 0.5006        | 37.0  | 8473  | 0.4364          | 0.8171 | 0.9586 | 0.9214 | 0.0       | 0.7011     | 0.8249    | 0.3635 | 0.8448 | 0.8844  | 0.0       | 0.7808     | 0.8935    | 0.8447  | 0.8936      | 0.8148         | 0.8844             | 0.7914   | 0.8687       | 0.8181  | 0.8918      | 0.8164    | 0.8834        |

| 0.4862        | 38.0  | 8702  | 0.4287          | 0.8104 | 0.9598 | 0.9135 | 0.0       | 0.7261     | 0.8158    | 0.3582 | 0.8422 | 0.8806  | 0.0       | 0.8008     | 0.8879    | 0.843   | 0.8947      | 0.8215         | 0.8913             | 0.8011   | 0.8721       | 0.7848  | 0.8672      | 0.8015    | 0.8776        |

| 0.4862        | 39.0  | 8931  | 0.4381          | 0.8088 | 0.9565 | 0.9112 | 0.0       | 0.7092     | 0.8165    | 0.3586 | 0.8421 | 0.8833  | 0.0       | 0.7832     | 0.8931    | 0.842   | 0.8954      | 0.8195         | 0.8916             | 0.7791   | 0.8664       | 0.7898  | 0.8706      | 0.8134    | 0.8926        |

| 0.467         | 40.0  | 9160  | 0.4064          | 0.8247 | 0.9641 | 0.9272 | 0.0       | 0.7091     | 0.8334    | 0.3659 | 0.8506 | 0.8873  | 0.0       | 0.7813     | 0.8972    | 0.8478  | 0.8972      | 0.8326         | 0.8964             | 0.7952   | 0.8716       | 0.8167  | 0.8814      | 0.8313    | 0.8901        |

| 0.467         | 41.0  | 9389  | 0.4180          | 0.8301 | 0.9634 | 0.926  | 0.0284    | 0.7306     | 0.8379    | 0.3643 | 0.8528 | 0.8907  | 0.05      | 0.8049     | 0.8986    | 0.856   | 0.8991      | 0.8307         | 0.8949             | 0.812    | 0.8768       | 0.8181  | 0.8843      | 0.8336    | 0.8982        |

| 0.4425        | 42.0  | 9618  | 0.4123          | 0.8297 | 0.9644 | 0.9247 | 0.0       | 0.7309     | 0.8382    | 0.3647 | 0.8541 | 0.8903  | 0.0       | 0.8033     | 0.8985    | 0.8575  | 0.9011      | 0.8411         | 0.9026             | 0.8103   | 0.8795       | 0.8069  | 0.8672      | 0.8325    | 0.9011        |

| 0.4425        | 43.0  | 9847  | 0.3825          | 0.8389 | 0.9691 | 0.9398 | 0.0       | 0.7355     | 0.8473    | 0.3697 | 0.8586 | 0.8978  | 0.0       | 0.806      | 0.9065    | 0.8608  | 0.9044      | 0.8405         | 0.9065             | 0.8139   | 0.8834       | 0.8374  | 0.8913      | 0.8417    | 0.9033        |

| 0.4263        | 44.0  | 10076 | 0.3773          | 0.8377 | 0.9684 | 0.931  | 0.0       | 0.7218     | 0.8459    | 0.3644 | 0.856  | 0.8949  | 0.0       | 0.7984     | 0.9029    | 0.8612  | 0.9027      | 0.8361         | 0.8981             | 0.822    | 0.884        | 0.8272  | 0.8877      | 0.8418    | 0.9018        |

| 0.4263        | 45.0  | 10305 | 0.3904          | 0.824  | 0.9688 | 0.9284 | 0.0084    | 0.7317     | 0.8306    | 0.3598 | 0.8491 | 0.8863  | 0.0167    | 0.8004     | 0.894     | 0.8516  | 0.895       | 0.8268         | 0.8931             | 0.8067   | 0.8747       | 0.817   | 0.8841      | 0.8182    | 0.8847        |

| 0.4204        | 46.0  | 10534 | 0.3656          | 0.8462 | 0.974  | 0.9396 | 0.0       | 0.7568     | 0.8524    | 0.3682 | 0.8649 | 0.9007  | 0.0       | 0.8266     | 0.9073    | 0.8657  | 0.9099      | 0.8506         | 0.9074             | 0.8161   | 0.8809       | 0.8292  | 0.8877      | 0.8694    | 0.9175        |

| 0.4204        | 47.0  | 10763 | 0.3758          | 0.8349 | 0.9718 | 0.9392 | 0.0       | 0.7035     | 0.8459    | 0.368  | 0.855  | 0.8913  | 0.0       | 0.7802     | 0.9019    | 0.8541  | 0.8991      | 0.8451         | 0.8987             | 0.8029   | 0.8726       | 0.8283  | 0.886       | 0.8443    | 0.9           |

| 0.4204        | 48.0  | 10992 | 0.3809          | 0.8353 | 0.9678 | 0.9295 | 0.0118    | 0.7351     | 0.8425    | 0.3663 | 0.857  | 0.893   | 0.05      | 0.8026     | 0.9015    | 0.8607  | 0.9038      | 0.8356         | 0.8969             | 0.7936   | 0.8686       | 0.8459  | 0.8983      | 0.8406    | 0.8972        |

| 0.3935        | 49.0  | 11221 | 0.3698          | 0.8474 | 0.9735 | 0.9409 | -1.0      | 0.7592     | 0.8521    | 0.3697 | 0.8651 | 0.9015  | -1.0      | 0.8194     | 0.9087    | 0.8689  | 0.9079      | 0.858          | 0.9095             | 0.8152   | 0.8836       | 0.8403  | 0.8993      | 0.8546    | 0.9072        |

| 0.3935        | 50.0  | 11450 | 0.3514          | 0.8575 | 0.9736 | 0.9426 | -1.0      | 0.7425     | 0.8654    | 0.374  | 0.8699 | 0.9073  | -1.0      | 0.8195     | 0.9155    | 0.8727  | 0.911       | 0.8644         | 0.9151             | 0.8218   | 0.8843       | 0.8571  | 0.9039      | 0.8714    | 0.9225        |

| 0.3968        | 51.0  | 11679 | 0.3494          | 0.8593 | 0.9771 | 0.9505 | 0.0       | 0.7601     | 0.8679    | 0.3719 | 0.8711 | 0.9076  | 0.0       | 0.8205     | 0.9161    | 0.8777  | 0.914       | 0.861          | 0.9132             | 0.8315   | 0.8882       | 0.8538  | 0.9022      | 0.8727    | 0.9202        |

| 0.3968        | 52.0  | 11908 | 0.3445          | 0.8562 | 0.9765 | 0.9461 | 0.0       | 0.7603     | 0.8639    | 0.3721 | 0.8684 | 0.9052  | 0.0       | 0.8178     | 0.9136    | 0.8709  | 0.9081      | 0.8565         | 0.9057             | 0.8201   | 0.8807       | 0.8635  | 0.9106      | 0.8698    | 0.921         |

| 0.3821        | 53.0  | 12137 | 0.3250          | 0.8633 | 0.9803 | 0.9565 | 0.0       | 0.7553     | 0.873     | 0.3764 | 0.8752 | 0.9117  | 0.0       | 0.8214     | 0.9208    | 0.8715  | 0.9119      | 0.8656         | 0.9148             | 0.8328   | 0.893        | 0.8728  | 0.9166      | 0.8738    | 0.9221        |

| 0.3821        | 54.0  | 12366 | 0.3107          | 0.875  | 0.9819 | 0.9631 | 0.5       | 0.775      | 0.8823    | 0.3779 | 0.8859 | 0.9192  | 0.5       | 0.8342     | 0.9269    | 0.884   | 0.9199      | 0.8872         | 0.9289             | 0.8457   | 0.8988       | 0.8765  | 0.9205      | 0.8814    | 0.9279        |

| 0.3697        | 55.0  | 12595 | 0.3092          | 0.8724 | 0.9804 | 0.9569 | 0.0125    | 0.7686     | 0.8796    | 0.3769 | 0.8803 | 0.9152  | 0.05      | 0.8259     | 0.923     | 0.8804  | 0.9167      | 0.8782         | 0.9198             | 0.8347   | 0.8895       | 0.8778  | 0.9195      | 0.8907    | 0.9305        |

| 0.3697        | 56.0  | 12824 | 0.3221          | 0.865  | 0.9815 | 0.9558 | 0.0       | 0.7603     | 0.8733    | 0.3748 | 0.8764 | 0.9117  | 0.0       | 0.8283     | 0.9199    | 0.8776  | 0.9166      | 0.8651         | 0.9133             | 0.8387   | 0.8942       | 0.8605  | 0.9114      | 0.883     | 0.923         |

| 0.3658        | 57.0  | 13053 | 0.3189          | 0.8614 | 0.9765 | 0.952  | 0.0       | 0.744      | 0.8687    | 0.3718 | 0.8728 | 0.9055  | 0.0       | 0.7956     | 0.9155    | 0.883   | 0.9187      | 0.8745         | 0.9148             | 0.8342   | 0.8899       | 0.8478  | 0.8961      | 0.8672    | 0.9077        |

| 0.3658        | 58.0  | 13282 | 0.3202          | 0.8636 | 0.9787 | 0.9492 | 0.0167    | 0.7338     | 0.8732    | 0.3733 | 0.8727 | 0.9082  | 0.0333    | 0.8006     | 0.918     | 0.8787  | 0.9145      | 0.8703         | 0.9139             | 0.8363   | 0.8902       | 0.8577  | 0.9053      | 0.8747    | 0.9173        |

| 0.3469        | 59.0  | 13511 | 0.3084          | 0.8795 | 0.9815 | 0.957  | 0.0       | 0.7775     | 0.8865    | 0.3786 | 0.8846 | 0.9188  | 0.0       | 0.8365     | 0.9258    | 0.8897  | 0.9219      | 0.8825         | 0.9237             | 0.8477   | 0.8984       | 0.8844  | 0.9217      | 0.8933    | 0.928         |

| 0.3469        | 60.0  | 13740 | 0.3030          | 0.8802 | 0.982  | 0.9588 | 0.0269    | 0.7834     | 0.8881    | 0.3799 | 0.8839 | 0.9186  | 0.1333    | 0.8397     | 0.926     | 0.893   | 0.9249      | 0.8857         | 0.9241             | 0.8494   | 0.9001       | 0.8859  | 0.9195      | 0.8869    | 0.9243        |

| 0.3469        | 61.0  | 13969 | 0.3030          | 0.8778 | 0.983  | 0.964  | 0.0071    | 0.7856     | 0.8853    | 0.3808 | 0.8833 | 0.9177  | 0.05      | 0.8419     | 0.9246    | 0.884   | 0.9182      | 0.8816         | 0.9221             | 0.8455   | 0.8948       | 0.8868  | 0.9239      | 0.891     | 0.9298        |

| 0.3303        | 62.0  | 14198 | 0.3037          | 0.8785 | 0.9819 | 0.9582 | 0.0024    | 0.7757     | 0.8866    | 0.3783 | 0.8847 | 0.919   | 0.0333    | 0.8334     | 0.9269    | 0.8897  | 0.9227      | 0.8862         | 0.9257             | 0.8444   | 0.8991       | 0.8717  | 0.913       | 0.9007    | 0.9344        |

| 0.3303        | 63.0  | 14427 | 0.2819          | 0.8859 | 0.9829 | 0.9624 | 0.0       | 0.7911     | 0.8923    | 0.3813 | 0.8888 | 0.9229  | 0.0       | 0.847      | 0.9297    | 0.8949  | 0.925       | 0.8976         | 0.9325             | 0.8558   | 0.9084       | 0.8822  | 0.9164      | 0.8988    | 0.932         |

| 0.3278        | 64.0  | 14656 | 0.2771          | 0.8886 | 0.9878 | 0.9668 | 0.0       | 0.8116     | 0.8935    | 0.3804 | 0.8916 | 0.9256  | 0.0       | 0.8659     | 0.9311    | 0.8912  | 0.9234      | 0.8903         | 0.9275             | 0.8564   | 0.9065       | 0.8982  | 0.9316      | 0.9071    | 0.9388        |

| 0.3278        | 65.0  | 14885 | 0.2647          | 0.8869 | 0.9805 | 0.961  | 0.0       | 0.7776     | 0.8956    | 0.3814 | 0.8904 | 0.9236  | 0.0       | 0.8299     | 0.9323    | 0.8997  | 0.9306      | 0.9027         | 0.9357             | 0.8565   | 0.9077       | 0.8827  | 0.92        | 0.8928    | 0.9242        |

| 0.3251        | 66.0  | 15114 | 0.2738          | 0.8856 | 0.9815 | 0.9598 | 0.0       | 0.8047     | 0.893     | 0.3808 | 0.8898 | 0.9219  | 0.0       | 0.8593     | 0.9286    | 0.9009  | 0.9303      | 0.8936         | 0.9269             | 0.8504   | 0.9014       | 0.8972  | 0.9314      | 0.8858    | 0.9193        |

| 0.3251        | 67.0  | 15343 | 0.2822          | 0.892  | 0.9846 | 0.9658 | 0.0126    | 0.8003     | 0.9007    | 0.3816 | 0.8941 | 0.9282  | 0.0125    | 0.8611     | 0.9352    | 0.8977  | 0.9294      | 0.8929         | 0.9286             | 0.8681   | 0.915        | 0.8899  | 0.9265      | 0.9112    | 0.9417        |

| 0.3013        | 68.0  | 15572 | 0.2507          | 0.8976 | 0.9867 | 0.9696 | 0.0       | 0.8044     | 0.9054    | 0.3832 | 0.8975 | 0.9315  | 0.0       | 0.857      | 0.939     | 0.9076  | 0.9355      | 0.9059         | 0.9371             | 0.8672   | 0.9138       | 0.8885  | 0.9224      | 0.9187    | 0.9487        |

| 0.3013        | 69.0  | 15801 | 0.2612          | 0.893  | 0.9817 | 0.9624 | 0.0       | 0.7973     | 0.9006    | 0.3835 | 0.8937 | 0.9269  | 0.0       | 0.8556     | 0.934     | 0.9004  | 0.9302      | 0.9028         | 0.9359             | 0.8654   | 0.9148       | 0.9026  | 0.934       | 0.8935    | 0.9199        |

| 0.304         | 70.0  | 16030 | 0.2574          | 0.8952 | 0.9861 | 0.9674 | 0.0       | 0.8081     | 0.9022    | 0.3818 | 0.8942 | 0.9291  | 0.0       | 0.8607     | 0.9359    | 0.9026  | 0.9315      | 0.9017         | 0.9339             | 0.8629   | 0.91         | 0.8928  | 0.9267      | 0.9159    | 0.9432        |

| 0.304         | 71.0  | 16259 | 0.2560          | 0.9046 | 0.9867 | 0.9742 | 0.0       | 0.8298     | 0.9113    | 0.3859 | 0.9039 | 0.9375  | 0.0       | 0.8826     | 0.943     | 0.9075  | 0.9358      | 0.9111         | 0.9415             | 0.881    | 0.9258       | 0.9036  | 0.9376      | 0.9198    | 0.9467        |

| 0.304         | 72.0  | 16488 | 0.2442          | 0.903  | 0.987  | 0.9698 | 0.0034    | 0.8363     | 0.9081    | 0.3847 | 0.9018 | 0.9352  | 0.0167    | 0.8818     | 0.9404    | 0.9112  | 0.9385      | 0.9058         | 0.938              | 0.8752   | 0.9186       | 0.9004  | 0.9335      | 0.9226    | 0.9475        |

| 0.3017        | 73.0  | 16717 | 0.2676          | 0.8941 | 0.9846 | 0.9587 | 0.0084    | 0.8202     | 0.8994    | 0.3801 | 0.8937 | 0.9293  | 0.0083    | 0.87       | 0.9359    | 0.9087  | 0.937       | 0.8989         | 0.9333             | 0.8619   | 0.9114       | 0.884   | 0.9229      | 0.9169    | 0.9419        |

| 0.3017        | 74.0  | 16946 | 0.2373          | 0.903  | 0.9862 | 0.9702 | 0.0       | 0.7937     | 0.9116    | 0.3851 | 0.8997 | 0.9344  | 0.0       | 0.8474     | 0.9419    | 0.9126  | 0.9385      | 0.9112         | 0.9396             | 0.8675   | 0.9163       | 0.9068  | 0.9337      | 0.917     | 0.9439        |

| 0.2849        | 75.0  | 17175 | 0.2357          | 0.9066 | 0.987  | 0.9718 | 0.0       | 0.8228     | 0.9138    | 0.388  | 0.9034 | 0.9373  | 0.0       | 0.8698     | 0.9439    | 0.9141  | 0.9398      | 0.9108         | 0.9387             | 0.8752   | 0.9183       | 0.9063  | 0.9386      | 0.9265    | 0.9513        |

| 0.2849        | 76.0  | 17404 | 0.2351          | 0.9061 | 0.986  | 0.9681 | 0.1346    | 0.8157     | 0.9135    | 0.3849 | 0.9031 | 0.9369  | 0.325     | 0.8683     | 0.9434    | 0.91    | 0.9381      | 0.9141         | 0.9436             | 0.8761   | 0.9196       | 0.905   | 0.9299      | 0.9252    | 0.9531        |

| 0.2899        | 77.0  | 17633 | 0.2298          | 0.9137 | 0.9872 | 0.9734 | 0.0       | 0.8293     | 0.9202    | 0.3871 | 0.9096 | 0.9434  | 0.0       | 0.8766     | 0.9497    | 0.9192  | 0.9454      | 0.9188         | 0.9461             | 0.8862   | 0.9286       | 0.9181  | 0.9422      | 0.926     | 0.955         |

| 0.2899        | 78.0  | 17862 | 0.2373          | 0.9104 | 0.9886 | 0.9733 | 0.35      | 0.8262     | 0.9174    | 0.3891 | 0.9066 | 0.9403  | 0.35      | 0.8769     | 0.9464    | 0.9096  | 0.937       | 0.9154         | 0.9429             | 0.8764   | 0.9227       | 0.9166  | 0.9439      | 0.9342    | 0.9552        |

| 0.2693        | 79.0  | 18091 | 0.2322          | 0.9124 | 0.9879 | 0.9708 | 0.0       | 0.8266     | 0.9192    | 0.3883 | 0.9064 | 0.9413  | 0.0       | 0.8753     | 0.9479    | 0.9163  | 0.9405      | 0.9172         | 0.9445             | 0.872    | 0.9175       | 0.9235  | 0.9467      | 0.933     | 0.957         |

| 0.2693        | 80.0  | 18320 | 0.2238          | 0.9089 | 0.9866 | 0.9742 | 0.0       | 0.8083     | 0.917     | 0.3856 | 0.9059 | 0.9396  | 0.0       | 0.8627     | 0.947     | 0.9136  | 0.9396      | 0.9164         | 0.9438             | 0.8796   | 0.9245       | 0.9116  | 0.9402      | 0.9232    | 0.9498        |

| 0.2788        | 81.0  | 18549 | 0.2170          | 0.9152 | 0.9886 | 0.972  | 0.0       | 0.8325     | 0.9226    | 0.3876 | 0.9096 | 0.9429  | 0.0       | 0.8803     | 0.9496    | 0.9193  | 0.9439      | 0.9149         | 0.9416             | 0.8833   | 0.9238       | 0.9195  | 0.9448      | 0.9388    | 0.9605        |

| 0.2788        | 82.0  | 18778 | 0.2155          | 0.9176 | 0.989  | 0.9729 | 0.015     | 0.8253     | 0.9246    | 0.3904 | 0.9117 | 0.9457  | 0.0444    | 0.8758     | 0.9526    | 0.9229  | 0.9477      | 0.9203         | 0.9455             | 0.8828   | 0.9266       | 0.9315  | 0.953       | 0.9304    | 0.9554        |

| 0.2722        | 83.0  | 19007 | 0.2300          | 0.9146 | 0.9869 | 0.9712 | 0.0833    | 0.8085     | 0.9234    | 0.39   | 0.9095 | 0.9426  | 0.1667    | 0.8611     | 0.9506    | 0.9219  | 0.9469      | 0.9209         | 0.9486             | 0.8859   | 0.925        | 0.9125  | 0.9414      | 0.9317    | 0.951         |

| 0.2722        | 84.0  | 19236 | 0.2123          | 0.9149 | 0.9883 | 0.9744 | 0.0       | 0.8187     | 0.9234    | 0.3888 | 0.9085 | 0.9431  | 0.0       | 0.8665     | 0.9504    | 0.9188  | 0.9437      | 0.9197         | 0.9461             | 0.8905   | 0.9296       | 0.9228  | 0.9482      | 0.9228    | 0.9482        |

| 0.2722        | 85.0  | 19465 | 0.2406          | 0.9132 | 0.9883 | 0.9684 | 0.0       | 0.8322     | 0.9192    | 0.3888 | 0.9084 | 0.9419  | 0.0       | 0.8782     | 0.9479    | 0.9134  | 0.9384      | 0.9185         | 0.9455             | 0.8773   | 0.9221       | 0.9225  | 0.9473      | 0.9343    | 0.9562        |

| 0.2645        | 86.0  | 19694 | 0.2162          | 0.9146 | 0.9872 | 0.9708 | 0.0       | 0.8075     | 0.9233    | 0.3889 | 0.9099 | 0.9428  | 0.0       | 0.8611     | 0.9508    | 0.9178  | 0.9423      | 0.9216         | 0.9457             | 0.8741   | 0.9202       | 0.9291  | 0.9531      | 0.9305    | 0.9525        |

| 0.2645        | 87.0  | 19923 | 0.2313          | 0.9084 | 0.9867 | 0.9664 | 0.021     | 0.8051     | 0.9165    | 0.3869 | 0.9034 | 0.9375  | 0.0208    | 0.8589     | 0.9457    | 0.9137  | 0.9389      | 0.9103         | 0.9395             | 0.8742   | 0.9172       | 0.9104  | 0.9367      | 0.9335    | 0.9551        |

| 0.2632        | 88.0  | 20152 | 0.2140          | 0.9193 | 0.9901 | 0.9727 | 0.0       | 0.816      | 0.9281    | 0.3899 | 0.9123 | 0.9467  | 0.0       | 0.8733     | 0.9544    | 0.9199  | 0.9447      | 0.9223         | 0.9469             | 0.8829   | 0.9278       | 0.9297  | 0.9547      | 0.9416    | 0.9594        |

| 0.2632        | 89.0  | 20381 | 0.2108          | 0.9206 | 0.9908 | 0.976  | 0.0063    | 0.8369     | 0.9282    | 0.391  | 0.9129 | 0.947   | 0.05      | 0.8829     | 0.9536    | 0.9238  | 0.9483      | 0.9253         | 0.9497             | 0.8896   | 0.9292       | 0.9271  | 0.9495      | 0.937     | 0.9586        |

| 0.2558        | 90.0  | 20610 | 0.2074          | 0.9226 | 0.9892 | 0.9725 | 0.0       | 0.8464     | 0.928     | 0.3893 | 0.9148 | 0.9487  | 0.0       | 0.891      | 0.9539    | 0.9259  | 0.949       | 0.925          | 0.9484             | 0.8913   | 0.9325       | 0.9404  | 0.961       | 0.9306    | 0.9526        |

| 0.2558        | 91.0  | 20839 | 0.2065          | 0.9177 | 0.9878 | 0.9746 | 0.0       | 0.8105     | 0.9259    | 0.3885 | 0.9111 | 0.9445  | 0.0       | 0.8607     | 0.9517    | 0.9222  | 0.9467      | 0.9217         | 0.9486             | 0.8915   | 0.9302       | 0.9299  | 0.9499      | 0.9234    | 0.9473        |

| 0.265         | 92.0  | 21068 | 0.2300          | 0.9179 | 0.9868 | 0.9712 | 0.0097    | 0.8343     | 0.9248    | 0.389  | 0.9108 | 0.9445  | 0.0188    | 0.8792     | 0.9513    | 0.9164  | 0.9403      | 0.9173         | 0.9422             | 0.8884   | 0.9269       | 0.9373  | 0.9595      | 0.9301    | 0.9537        |

| 0.265         | 93.0  | 21297 | 0.2123          | 0.917  | 0.9855 | 0.971  | 0.0       | 0.8412     | 0.923     | 0.3896 | 0.9118 | 0.9435  | 0.0       | 0.8862     | 0.949     | 0.9235  | 0.9473      | 0.925          | 0.9516             | 0.8916   | 0.9309       | 0.9297  | 0.9518      | 0.9151    | 0.936         |

| 0.2552        | 94.0  | 21526 | 0.2158          | 0.9163 | 0.9871 | 0.9692 | 0.025     | 0.8201     | 0.9236    | 0.3899 | 0.9089 | 0.9439  | 0.1       | 0.873      | 0.9505    | 0.9188  | 0.9427      | 0.9236         | 0.9469             | 0.8851   | 0.9264       | 0.9271  | 0.9531      | 0.9271    | 0.9506        |

| 0.2552        | 95.0  | 21755 | 0.2067          | 0.9214 | 0.988  | 0.9719 | 0.0       | 0.8358     | 0.9286    | 0.39   | 0.9138 | 0.9476  | 0.0       | 0.8828     | 0.9537    | 0.9278  | 0.9507      | 0.9285         | 0.9518             | 0.8957   | 0.9347       | 0.9325  | 0.9538      | 0.9228    | 0.9471        |

| 0.2552        | 96.0  | 21984 | 0.2016          | 0.9214 | 0.9878 | 0.975  | 0.0       | 0.8237     | 0.9293    | 0.3906 | 0.9143 | 0.9484  | 0.0       | 0.8765     | 0.9548    | 0.926   | 0.9492      | 0.9283         | 0.9538             | 0.8922   | 0.9316       | 0.9259  | 0.9513      | 0.9345    | 0.9559        |

| 0.2594        | 97.0  | 22213 | 0.2237          | 0.9166 | 0.9877 | 0.972  | 0.0333    | 0.83       | 0.9224    | 0.3894 | 0.9092 | 0.9447  | 0.2       | 0.8798     | 0.9506    | 0.9183  | 0.9446      | 0.9215         | 0.9472             | 0.8878   | 0.9291       | 0.9204  | 0.9484      | 0.9348    | 0.9545        |

| 0.2594        | 98.0  | 22442 | 0.2155          | 0.9158 | 0.9867 | 0.9685 | 0.0       | 0.8188     | 0.9233    | 0.3865 | 0.9102 | 0.9434  | 0.0       | 0.8684     | 0.9503    | 0.9268  | 0.9478      | 0.9204         | 0.9479             | 0.885    | 0.9271       | 0.9187  | 0.9419      | 0.928     | 0.9523        |

| 0.2586        | 99.0  | 22671 | 0.2212          | 0.918  | 0.9888 | 0.9709 | 0.0333    | 0.833      | 0.9245    | 0.39   | 0.9105 | 0.9444  | 0.1       | 0.8802     | 0.9506    | 0.9185  | 0.9424      | 0.927          | 0.9502             | 0.8793   | 0.9223       | 0.9301  | 0.9513      | 0.9351    | 0.9558        |

| 0.2586        | 100.0 | 22900 | 0.2233          | 0.9186 | 0.9888 | 0.9702 | 0.0168    | 0.8326     | 0.9267    | 0.39   | 0.9118 | 0.9461  | 0.0167    | 0.883      | 0.953     | 0.9208  | 0.9447      | 0.9227         | 0.9476             | 0.8797   | 0.9232       | 0.93    | 0.9552      | 0.94      | 0.9599        |





### Framework versions



- Transformers 4.42.3

- Pytorch 2.3.1+cu121

- Datasets 2.20.0

- Tokenizers 0.19.1