transformers safetensors segformer vision image-segmentation generated_from_trainer base_model:nvidia/mit-b0 license:other endpoints_compatible region:us
---
license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b0-winter_2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b0-winter_2

This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the johanhag/winter dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0665
- Mean Iou: 0.7168
- Mean Accuracy: 0.7840
- Overall Accuracy: 0.9775
- Accuracy Unlabeled: nan
- Accuracy Road: 0.9559
- Accuracy Side walk: 0.7693
- Accuracy Car: 0.8882
- Accuracy Pedestrian: 0.8345
- Accuracy Sign: 0.2653
- Accuracy Other: 0.9907
- Iou Unlabeled: nan
- Iou Road: 0.9088
- Iou Side walk: 0.6583
- Iou Car: 0.7943
- Iou Pedestrian: 0.7201
- Iou Sign: 0.2393
- Iou Other: 0.9799

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 50

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Road | Accuracy Side walk | Accuracy Car | Accuracy Pedestrian | Accuracy Sign | Accuracy Other | Iou Unlabeled | Iou Road | Iou Side walk | Iou Car | Iou Pedestrian | Iou Sign | Iou Other |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:-------------:|:------------------:|:------------:|:-------------------:|:-------------:|:--------------:|:-------------:|:--------:|:-------------:|:-------:|:--------------:|:--------:|:---------:|
| 1.2678        | 0.37  | 20   | 1.4585          | 0.2824   | 0.4123        | 0.8374           | nan                | 0.9932        | 0.0                | 0.6072       | 0.0205              | 0.0           | 0.8528         | nan           | 0.4383   | 0.0           | 0.3876  | 0.0204         | 0.0      | 0.8480    |
| 0.9377        | 0.74  | 40   | 0.9219          | 0.3461   | 0.4345        | 0.9161           | nan                | 0.9666        | 0.0013             | 0.6904       | 0.0                 | 0.0           | 0.9490         | nan           | 0.6449   | 0.0013        | 0.5036  | 0.0            | 0.0      | 0.9265    |
| 0.7819        | 1.11  | 60   | 0.7375          | 0.3622   | 0.4469        | 0.9248           | nan                | 0.9687        | 0.0098             | 0.7451       | 0.0                 | 0.0           | 0.9576         | nan           | 0.6748   | 0.0095        | 0.5520  | 0.0            | 0.0      | 0.9367    |
| 0.687         | 1.48  | 80   | 0.6354          | 0.3674   | 0.4573        | 0.9286           | nan                | 0.9687        | 0.0131             | 0.8014       | 0.0                 | 0.0           | 0.9608         | nan           | 0.6873   | 0.0130        | 0.5626  | 0.0            | 0.0      | 0.9417    |
| 0.552         | 1.85  | 100  | 0.5199          | 0.3753   | 0.4700        | 0.9360           | nan                | 0.9564        | 0.0246             | 0.8691       | 0.0                 | 0.0           | 0.9697         | nan           | 0.7283   | 0.0246        | 0.5492  | 0.0            | 0.0      | 0.9497    |
| 0.521         | 2.22  | 120  | 0.4620          | 0.3897   | 0.4651        | 0.9419           | nan                | 0.9413        | 0.0622             | 0.8083       | 0.0                 | 0.0           | 0.9791         | nan           | 0.7606   | 0.0615        | 0.5631  | 0.0            | 0.0      | 0.9531    |
| 0.3901        | 2.59  | 140  | 0.4255          | 0.4088   | 0.5067        | 0.9398           | nan                | 0.9671        | 0.1414             | 0.8939       | 0.0695              | 0.0           | 0.9684         | nan           | 0.7369   | 0.1358        | 0.5570  | 0.0694         | 0.0      | 0.9540    |
| 0.4172        | 2.96  | 160  | 0.3836          | 0.4307   | 0.5198        | 0.9436           | nan                | 0.9591        | 0.2494             | 0.8904       | 0.0485              | 0.0           | 0.9714         | nan           | 0.7552   | 0.2212        | 0.6043  | 0.0485         | 0.0      | 0.9552    |
| 0.2995        | 3.33  | 180  | 0.3209          | 0.4755   | 0.5497        | 0.9483           | nan                | 0.9631        | 0.1625             | 0.8542       | 0.3417              | 0.0           | 0.9768         | nan           | 0.7656   | 0.1585        | 0.6356  | 0.3340         | 0.0      | 0.9592    |
| 1.6503        | 3.7   | 200  | 0.2891          | 0.4914   | 0.5539        | 0.9529           | nan                | 0.9505        | 0.4372             | 0.7938       | 0.1621              | 0.0           | 0.9797         | nan           | 0.8021   | 0.3827        | 0.6457  | 0.1592         | 0.0      | 0.9585    |
| 0.2506        | 4.07  | 220  | 0.2502          | 0.4813   | 0.5573        | 0.9537           | nan                | 0.9412        | 0.3606             | 0.8825       | 0.1774              | 0.0           | 0.9820         | nan           | 0.8068   | 0.3260        | 0.6168  | 0.1758         | 0.0      | 0.9625    |
| 0.2336        | 4.44  | 240  | 0.2367          | 0.5543   | 0.6178        | 0.9610           | nan                | 0.9211        | 0.4445             | 0.8401       | 0.5124              | 0.0           | 0.9889         | nan           | 0.8354   | 0.4044        | 0.6477  | 0.4713         | 0.0      | 0.9670    |
| 0.1932        | 4.81  | 260  | 0.2088          | 0.5436   | 0.5960        | 0.9613           | nan                | 0.9283        | 0.4497             | 0.8144       | 0.3935              | 0.0           | 0.9898         | nan           | 0.8360   | 0.4188        | 0.6606  | 0.3794         | 0.0      | 0.9667    |
| 1.8362        | 5.19  | 280  | 0.1866          | 0.5727   | 0.6422        | 0.9628           | nan                | 0.9358        | 0.4776             | 0.8185       | 0.6339              | 0.0           | 0.9876         | nan           | 0.8474   | 0.4320        | 0.6612  | 0.5279         | 0.0      | 0.9679    |
| 0.2085        | 5.56  | 300  | 0.1677          | 0.5749   | 0.6321        | 0.9646           | nan                | 0.9571        | 0.4811             | 0.7743       | 0.5920              | 0.0           | 0.9881         | nan           | 0.8488   | 0.4438        | 0.6761  | 0.5099         | 0.0      | 0.9706    |
| 0.1389        | 5.93  | 320  | 0.1566          | 0.5761   | 0.6368        | 0.9641           | nan                | 0.9566        | 0.5138             | 0.8141       | 0.5499              | 0.0           | 0.9862         | nan           | 0.8483   | 0.4661        | 0.6803  | 0.4929         | 0.0      | 0.9693    |
| 0.1799        | 6.3   | 340  | 0.1620          | 0.5836   | 0.6678        | 0.9625           | nan                | 0.9604        | 0.5769             | 0.8649       | 0.6244              | 0.0           | 0.9802         | nan           | 0.8437   | 0.4753        | 0.6798  | 0.5350         | 0.0      | 0.9679    |
| 0.1291        | 6.67  | 360  | 0.1400          | 0.5926   | 0.6680        | 0.9649           | nan                | 0.9637        | 0.5702             | 0.8362       | 0.6548              | 0.0           | 0.9831         | nan           | 0.8505   | 0.4971        | 0.6900  | 0.5478         | 0.0      | 0.9701    |
| 0.1275        | 7.04  | 380  | 0.1505          | 0.5710   | 0.6346        | 0.9625           | nan                | 0.9682        | 0.4619             | 0.7713       | 0.6220              | 0.0           | 0.9843         | nan           | 0.8387   | 0.4057        | 0.6858  | 0.5268         | 0.0      | 0.9691    |
| 0.0968        | 7.41  | 400  | 0.1368          | 0.5774   | 0.6363        | 0.9644           | nan                | 0.9666        | 0.4759             | 0.8145       | 0.5753              | 0.0           | 0.9859         | nan           | 0.8407   | 0.4348        | 0.6960  | 0.5216         | 0.0      | 0.9714    |
| 0.1279        | 7.78  | 420  | 0.1317          | 0.5911   | 0.6616        | 0.9665           | nan                | 0.9405        | 0.5449             | 0.9055       | 0.5909              | 0.0           | 0.9880         | nan           | 0.8677   | 0.4742        | 0.7002  | 0.5328         | 0.0      | 0.9714    |
| 0.0917        | 8.15  | 440  | 0.1217          | 0.6187   | 0.7110        | 0.9684           | nan                | 0.9505        | 0.7295             | 0.8745       | 0.7278              | 0.0           | 0.9834         | nan           | 0.8802   | 0.5694        | 0.7065  | 0.5843         | 0.0      | 0.9719    |
| 0.0896        | 8.52  | 460  | 0.1164          | 0.6055   | 0.6809        | 0.9678           | nan                | 0.9333        | 0.7235             | 0.8257       | 0.6158              | 0.0           | 0.9873         | nan           | 0.8787   | 0.5338        | 0.7053  | 0.5428         | 0.0      | 0.9722    |
| 0.0903        | 8.89  | 480  | 0.1186          | 0.6195   | 0.6956        | 0.9683           | nan                | 0.9632        | 0.6929             | 0.8345       | 0.6995              | 0.0           | 0.9836         | nan           | 0.8645   | 0.5528        | 0.7308  | 0.5960         | 0.0      | 0.9730    |
| 0.0943        | 9.26  | 500  | 0.1183          | 0.6205   | 0.7187        | 0.9672           | nan                | 0.9539        | 0.7619             | 0.8675       | 0.7483              | 0.0           | 0.9805         | nan           | 0.8773   | 0.5444        | 0.7161  | 0.6142         | 0.0      | 0.9709    |
| 0.0886        | 9.63  | 520  | 0.1080          | 0.6233   | 0.7010        | 0.9687           | nan                | 0.9665        | 0.6540             | 0.8584       | 0.7434              | 0.0           | 0.9838         | nan           | 0.8689   | 0.5572        | 0.7272  | 0.6140         | 0.0      | 0.9726    |
| 0.1024        | 10.0  | 540  | 0.1047          | 0.6224   | 0.6872        | 0.9706           | nan                | 0.9419        | 0.6739             | 0.8470       | 0.6710              | 0.0           | 0.9898         | nan           | 0.8803   | 0.5702        | 0.7278  | 0.5818         | 0.0      | 0.9744    |
| 0.0779        | 10.37 | 560  | 0.1116          | 0.6168   | 0.6841        | 0.9683           | nan                | 0.9726        | 0.5517             | 0.8334       | 0.7614              | 0.0           | 0.9856         | nan           | 0.8627   | 0.5211        | 0.7301  | 0.6145         | 0.0      | 0.9724    |
| 0.1082        | 10.74 | 580  | 0.1044          | 0.6277   | 0.7012        | 0.9695           | nan                | 0.9656        | 0.6787             | 0.8693       | 0.7096              | 0.0           | 0.9843         | nan           | 0.8712   | 0.5607        | 0.7441  | 0.6166         | 0.0      | 0.9736    |
| 0.0797        | 11.11 | 600  | 0.1004          | 0.6356   | 0.7205        | 0.9703           | nan                | 0.9625        | 0.7506             | 0.8580       | 0.7686              | 0.0           | 0.9834         | nan           | 0.8826   | 0.5894        | 0.7393  | 0.6292         | 0.0      | 0.9734    |
| 0.0766        | 11.48 | 620  | 0.0957          | 0.6377   | 0.7250        | 0.9714           | nan                | 0.9507        | 0.7480             | 0.8487       | 0.8162              | 0.0           | 0.9862         | nan           | 0.8869   | 0.6181        | 0.7356  | 0.6112         | 0.0      | 0.9743    |
| 0.1557        | 11.85 | 640  | 0.0951          | 0.6367   | 0.7029        | 0.9719           | nan                | 0.9529        | 0.7316             | 0.8288       | 0.7157              | 0.0           | 0.9883         | nan           | 0.8896   | 0.6117        | 0.7317  | 0.6125         | 0.0      | 0.9745    |
| 0.0623        | 12.22 | 660  | 0.0939          | 0.6462   | 0.7283        | 0.9726           | nan                | 0.9467        | 0.7844             | 0.8493       | 0.8022              | 0.0           | 0.9873         | nan           | 0.8923   | 0.6157        | 0.7518  | 0.6416         | 0.0      | 0.9756    |
| 0.0619        | 12.59 | 680  | 0.0976          | 0.6349   | 0.7030        | 0.9710           | nan                | 0.9603        | 0.7091             | 0.8715       | 0.6907              | 0.0           | 0.9861         | nan           | 0.8802   | 0.5868        | 0.7498  | 0.6182         | 0.0      | 0.9745    |
| 0.0617        | 12.96 | 700  | 0.0919          | 0.6354   | 0.7228        | 0.9719           | nan                | 0.9470        | 0.7145             | 0.8873       | 0.8003              | 0.0           | 0.9874         | nan           | 0.8887   | 0.5929        | 0.7426  | 0.6128         | 0.0      | 0.9756    |
| 0.0544        | 13.33 | 720  | 0.0870          | 0.6517   | 0.7173        | 0.9741           | nan                | 0.9465        | 0.7433             | 0.8302       | 0.7930              | 0.0           | 0.9907         | nan           | 0.9005   | 0.6367        | 0.7452  | 0.6518         | 0.0      | 0.9760    |
| 0.1027        | 13.7  | 740  | 0.0894          | 0.6446   | 0.7207        | 0.9728           | nan                | 0.9207        | 0.7490             | 0.8655       | 0.7973              | 0.0           | 0.9917         | nan           | 0.8926   | 0.6210        | 0.7383  | 0.6398         | 0.0      | 0.9755    |
| 0.0568        | 14.07 | 760  | 0.0897          | 0.6434   | 0.7118        | 0.9729           | nan                | 0.9570        | 0.7121             | 0.8779       | 0.7342              | 0.0016        | 0.9882         | nan           | 0.8947   | 0.6098        | 0.7497  | 0.6292         | 0.0016   | 0.9753    |
| 0.0612        | 14.44 | 780  | 0.0851          | 0.6517   | 0.7181        | 0.9740           | nan                | 0.9599        | 0.7121             | 0.8589       | 0.7874              | 0.0012        | 0.9890         | nan           | 0.8967   | 0.6182        | 0.7590  | 0.6582         | 0.0012   | 0.9766    |
| 0.076         | 14.81 | 800  | 0.0859          | 0.6485   | 0.7126        | 0.9735           | nan                | 0.9589        | 0.6878             | 0.8535       | 0.7830              | 0.0033        | 0.9894         | nan           | 0.8925   | 0.6028        | 0.7595  | 0.6563         | 0.0033   | 0.9765    |
| 0.0489        | 15.19 | 820  | 0.0815          | 0.6528   | 0.7188        | 0.9744           | nan                | 0.9484        | 0.7477             | 0.8180       | 0.7988              | 0.0090        | 0.9909         | nan           | 0.9011   | 0.6294        | 0.7421  | 0.6584         | 0.0090   | 0.9771    |
| 0.0859        | 15.56 | 840  | 0.0828          | 0.6555   | 0.7296        | 0.9738           | nan                | 0.9508        | 0.7726             | 0.8563       | 0.7974              | 0.0118        | 0.9884         | nan           | 0.8961   | 0.6231        | 0.7577  | 0.6674         | 0.0118   | 0.9768    |
| 0.0661        | 15.93 | 860  | 0.0840          | 0.6555   | 0.7190        | 0.9741           | nan                | 0.9603        | 0.7187             | 0.8370       | 0.7849              | 0.0234        | 0.9894         | nan           | 0.8993   | 0.6216        | 0.7473  | 0.6652         | 0.0234   | 0.9766    |
| 0.0654        | 16.3  | 880  | 0.0840          | 0.6584   | 0.7227        | 0.9742           | nan                | 0.9564        | 0.7158             | 0.8614       | 0.7876              | 0.0257        | 0.9895         | nan           | 0.8970   | 0.6175        | 0.7638  | 0.6699         | 0.0257   | 0.9767    |
| 0.0607        | 16.67 | 900  | 0.0822          | 0.6559   | 0.7390        | 0.9732           | nan                | 0.9545        | 0.7766             | 0.8700       | 0.8213              | 0.0253        | 0.9865         | nan           | 0.8920   | 0.6220        | 0.7645  | 0.6554         | 0.0253   | 0.9763    |
| 0.0497        | 17.04 | 920  | 0.0817          | 0.6673   | 0.7313        | 0.9748           | nan                | 0.9606        | 0.6869             | 0.8915       | 0.7878              | 0.0713        | 0.9897         | nan           | 0.8995   | 0.6138        | 0.7722  | 0.6698         | 0.0711   | 0.9773    |
| 0.0497        | 17.41 | 940  | 0.0841          | 0.6523   | 0.7202        | 0.9731           | nan                | 0.9672        | 0.6538             | 0.8894       | 0.7861              | 0.0371        | 0.9878         | nan           | 0.8868   | 0.5868        | 0.7649  | 0.6617         | 0.0371   | 0.9766    |
| 0.055         | 17.78 | 960  | 0.0832          | 0.6568   | 0.7440        | 0.9730           | nan                | 0.9510        | 0.8045             | 0.8484       | 0.8358              | 0.0383        | 0.9863         | nan           | 0.8946   | 0.6165        | 0.7569  | 0.6587         | 0.0383   | 0.9762    |
| 0.0967        | 18.15 | 980  | 0.0854          | 0.6650   | 0.7524        | 0.9726           | nan                | 0.9647        | 0.7887             | 0.8950       | 0.7981              | 0.0846        | 0.9836         | nan           | 0.8918   | 0.6210        | 0.7621  | 0.6561         | 0.0839   | 0.9752    |
| 0.0436        | 18.52 | 1000 | 0.0814          | 0.6623   | 0.7454        | 0.9739           | nan                | 0.9593        | 0.7287             | 0.8957       | 0.8436              | 0.0579        | 0.9871         | nan           | 0.8986   | 0.6138        | 0.7595  | 0.6672         | 0.0577   | 0.9767    |
| 0.0465        | 18.89 | 1020 | 0.0773          | 0.6646   | 0.7224        | 0.9754           | nan                | 0.9473        | 0.7419             | 0.8615       | 0.7462              | 0.0456        | 0.9919         | nan           | 0.9050   | 0.6357        | 0.7607  | 0.6632         | 0.0456   | 0.9777    |
| 0.0672        | 19.26 | 1040 | 0.0778          | 0.6713   | 0.7454        | 0.9751           | nan                | 0.9464        | 0.7716             | 0.8746       | 0.8165              | 0.0736        | 0.9898         | nan           | 0.9037   | 0.6316        | 0.7748  | 0.6671         | 0.0730   | 0.9776    |
| 0.0592        | 19.63 | 1060 | 0.0799          | 0.6616   | 0.7223        | 0.9747           | nan                | 0.9596        | 0.6442             | 0.8656       | 0.8116              | 0.0613        | 0.9912         | nan           | 0.8997   | 0.5864        | 0.7681  | 0.6765         | 0.0612   | 0.9776    |
| 0.0876        | 20.0  | 1080 | 0.0794          | 0.6712   | 0.7386        | 0.9745           | nan                | 0.9608        | 0.7370             | 0.8057       | 0.8434              | 0.0954        | 0.9893         | nan           | 0.8993   | 0.6468        | 0.7364  | 0.6735         | 0.0943   | 0.9767    |
| 0.0483        | 20.37 | 1100 | 0.0742          | 0.6783   | 0.7469        | 0.9760           | nan                | 0.9576        | 0.7331             | 0.8860       | 0.8272              | 0.0872        | 0.9901         | nan           | 0.9066   | 0.6469        | 0.7731  | 0.6784         | 0.0866   | 0.9782    |
| 0.0837        | 20.74 | 1120 | 0.0746          | 0.6756   | 0.7378        | 0.9762           | nan                | 0.9491        | 0.7350             | 0.8654       | 0.8146              | 0.0709        | 0.9920         | nan           | 0.9067   | 0.6411        | 0.7718  | 0.6849         | 0.0705   | 0.9785    |
| 0.0685        | 21.11 | 1140 | 0.0743          | 0.6787   | 0.7383        | 0.9759           | nan                | 0.9475        | 0.7316             | 0.8709       | 0.7859              | 0.1015        | 0.9921         | nan           | 0.9070   | 0.6387        | 0.7661  | 0.6817         | 0.1004   | 0.9781    |
| 0.0596        | 21.48 | 1160 | 0.0751          | 0.6762   | 0.7418        | 0.9753           | nan                | 0.9499        | 0.7516             | 0.8336       | 0.8182              | 0.1066        | 0.9909         | nan           | 0.9056   | 0.6307        | 0.7558  | 0.6827         | 0.1051   | 0.9776    |
| 0.0608        | 21.85 | 1180 | 0.0728          | 0.6833   | 0.7549        | 0.9763           | nan                | 0.9428        | 0.7846             | 0.8823       | 0.8219              | 0.1066        | 0.9911         | nan           | 0.9070   | 0.6479        | 0.7742  | 0.6862         | 0.1055   | 0.9789    |
| 0.0918        | 22.22 | 1200 | 0.0731          | 0.6846   | 0.7457        | 0.9763           | nan                | 0.9597        | 0.7567             | 0.8516       | 0.7984              | 0.1174        | 0.9904         | nan           | 0.9049   | 0.6518        | 0.7691  | 0.6875         | 0.1153   | 0.9787    |
| 0.0539        | 22.59 | 1220 | 0.0743          | 0.6785   | 0.7431        | 0.9756           | nan                | 0.9563        | 0.7037             | 0.8680       | 0.8308              | 0.1086        | 0.9909         | nan           | 0.9011   | 0.6200        | 0.7720  | 0.6918         | 0.1075   | 0.9786    |
| 0.112         | 22.96 | 1240 | 0.0732          | 0.6786   | 0.7429        | 0.9759           | nan                | 0.9550        | 0.7656             | 0.8544       | 0.8060              | 0.0862        | 0.9902         | nan           | 0.9026   | 0.6444        | 0.7701  | 0.6902         | 0.0856   | 0.9786    |
| 0.0719        | 23.33 | 1260 | 0.0752          | 0.6812   | 0.7419        | 0.9752           | nan                | 0.9556        | 0.7059             | 0.8454       | 0.8174              | 0.1363        | 0.9910         | nan           | 0.8975   | 0.6136        | 0.7681  | 0.6947         | 0.1347   | 0.9784    |
| 0.0669        | 23.7  | 1280 | 0.0769          | 0.6881   | 0.7787        | 0.9740           | nan                | 0.9620        | 0.7954             | 0.9020       | 0.8524              | 0.1760        | 0.9846         | nan           | 0.8958   | 0.6387        | 0.7668  | 0.6829         | 0.1678   | 0.9766    |
| 0.0493        | 24.07 | 1300 | 0.0759          | 0.6778   | 0.7518        | 0.9748           | nan                | 0.9568        | 0.7398             | 0.8994       | 0.7977              | 0.1284        | 0.9885         | nan           | 0.8995   | 0.6076        | 0.7751  | 0.6805         | 0.1260   | 0.9783    |
| 0.11          | 24.44 | 1320 | 0.0752          | 0.6879   | 0.7625        | 0.9751           | nan                | 0.9636        | 0.7402             | 0.8775       | 0.8339              | 0.1720        | 0.9879         | nan           | 0.9000   | 0.6242        | 0.7765  | 0.6846         | 0.1644   | 0.9779    |
| 0.0631        | 24.81 | 1340 | 0.0720          | 0.6898   | 0.7530        | 0.9763           | nan                | 0.9664        | 0.7223             | 0.8807       | 0.8130              | 0.1459        | 0.9896         | nan           | 0.9044   | 0.6431        | 0.7812  | 0.6906         | 0.1411   | 0.9786    |
| 0.038         | 25.19 | 1360 | 0.0719          | 0.6909   | 0.7599        | 0.9761           | nan                | 0.9491        | 0.7646             | 0.8841       | 0.8190              | 0.1522        | 0.9904         | nan           | 0.9034   | 0.6346        | 0.7828  | 0.6976         | 0.1480   | 0.9790    |
| 0.0431        | 25.56 | 1380 | 0.0721          | 0.6925   | 0.7596        | 0.9760           | nan                | 0.9651        | 0.7530             | 0.8864       | 0.8031              | 0.1614        | 0.9886         | nan           | 0.9033   | 0.6418        | 0.7848  | 0.6910         | 0.1558   | 0.9785    |
| 0.0289        | 25.93 | 1400 | 0.0711          | 0.6914   | 0.7587        | 0.9762           | nan                | 0.9381        | 0.7752             | 0.8909       | 0.7947              | 0.1614        | 0.9919         | nan           | 0.9045   | 0.6471        | 0.7738  | 0.6893         | 0.1549   | 0.9789    |
| 0.0426        | 26.3  | 1420 | 0.0706          | 0.6950   | 0.7523        | 0.9768           | nan                | 0.9640        | 0.7361             | 0.8359       | 0.8120              | 0.1746        | 0.9911         | nan           | 0.9078   | 0.6530        | 0.7639  | 0.6987         | 0.1673   | 0.9791    |
| 0.0467        | 26.67 | 1440 | 0.0707          | 0.6961   | 0.7609        | 0.9765           | nan                | 0.9479        | 0.7615             | 0.9029       | 0.7805              | 0.1813        | 0.9911         | nan           | 0.9072   | 0.6454        | 0.7790  | 0.6928         | 0.1734   | 0.9790    |
| 0.0408        | 27.04 | 1460 | 0.0709          | 0.6920   | 0.7549        | 0.9765           | nan                | 0.9492        | 0.7672             | 0.8323       | 0.8389              | 0.1500        | 0.9918         | nan           | 0.9080   | 0.6569        | 0.7628  | 0.7006         | 0.1450   | 0.9786    |
| 0.0615        | 27.41 | 1480 | 0.0703          | 0.6963   | 0.7537        | 0.9768           | nan                | 0.9581        | 0.7484             | 0.8667       | 0.7992              | 0.1587        | 0.9911         | nan           | 0.9084   | 0.6610        | 0.7770  | 0.7002         | 0.1525   | 0.9786    |
| 0.0533        | 27.78 | 1500 | 0.0706          | 0.6946   | 0.7582        | 0.9764           | nan                | 0.9456        | 0.7452             | 0.8519       | 0.8340              | 0.1799        | 0.9924         | nan           | 0.9061   | 0.6408        | 0.7720  | 0.6988         | 0.1708   | 0.9789    |
| 0.0711        | 28.15 | 1520 | 0.0706          | 0.6920   | 0.7510        | 0.9763           | nan                | 0.9534        | 0.7701             | 0.8629       | 0.7678              | 0.1608        | 0.9909         | nan           | 0.9047   | 0.6450        | 0.7784  | 0.6898         | 0.1554   | 0.9789    |
| 0.0393        | 28.52 | 1540 | 0.0682          | 0.6969   | 0.7657        | 0.9768           | nan                | 0.9478        | 0.7615             | 0.8731       | 0.8445              | 0.1756        | 0.9915         | nan           | 0.9068   | 0.6512        | 0.7821  | 0.6940         | 0.1677   | 0.9795    |
| 0.0554        | 28.89 | 1560 | 0.0692          | 0.6964   | 0.7709        | 0.9760           | nan                | 0.9589        | 0.7844             | 0.8853       | 0.8399              | 0.1685        | 0.9882         | nan           | 0.9025   | 0.6465        | 0.7864  | 0.7042         | 0.1603   | 0.9786    |
| 0.0434        | 29.26 | 1580 | 0.0701          | 0.7004   | 0.7726        | 0.9764           | nan                | 0.9626        | 0.7718             | 0.9017       | 0.8279              | 0.1836        | 0.9883         | nan           | 0.9042   | 0.6550        | 0.7841  | 0.7068         | 0.1736   | 0.9789    |
| 0.0291        | 29.63 | 1600 | 0.0697          | 0.6993   | 0.7828        | 0.9764           | nan                | 0.9514        | 0.7878             | 0.9098       | 0.8654              | 0.1934        | 0.9889         | nan           | 0.9074   | 0.6529        | 0.7792  | 0.6950         | 0.1820   | 0.9791    |
| 2.6544        | 30.0  | 1620 | 0.0684          | 0.6924   | 0.7548        | 0.9766           | nan                | 0.9521        | 0.7645             | 0.8669       | 0.8127              | 0.1414        | 0.9912         | nan           | 0.9047   | 0.6439        | 0.7817  | 0.7072         | 0.1378   | 0.9794    |
| 0.0575        | 30.37 | 1640 | 0.0695          | 0.7022   | 0.7716        | 0.9766           | nan                | 0.9572        | 0.7694             | 0.8932       | 0.8291              | 0.1913        | 0.9895         | nan           | 0.9055   | 0.6478        | 0.7868  | 0.7134         | 0.1807   | 0.9792    |
| 0.0445        | 30.74 | 1660 | 0.0695          | 0.6967   | 0.7644        | 0.9766           | nan                | 0.9469        | 0.7587             | 0.8831       | 0.8402              | 0.1661        | 0.9914         | nan           | 0.9087   | 0.6416        | 0.7843  | 0.7072         | 0.1596   | 0.9789    |
| 0.0487        | 31.11 | 1680 | 0.0700          | 0.7022   | 0.7674        | 0.9768           | nan                | 0.9598        | 0.7276             | 0.8745       | 0.8351              | 0.2170        | 0.9907         | nan           | 0.9066   | 0.6404        | 0.7870  | 0.7006         | 0.1996   | 0.9792    |
| 0.0539        | 31.48 | 1700 | 0.0700          | 0.6978   | 0.7634        | 0.9764           | nan                | 0.9489        | 0.7680             | 0.8586       | 0.8232              | 0.1903        | 0.9912         | nan           | 0.9054   | 0.6365        | 0.7813  | 0.7053         | 0.1791   | 0.9792    |
| 0.0617        | 31.85 | 1720 | 0.0717          | 0.7077   | 0.7777        | 0.9765           | nan                | 0.9562        | 0.7683             | 0.8947       | 0.8146              | 0.2433        | 0.9895         | nan           | 0.9038   | 0.6415        | 0.7921  | 0.7096         | 0.2201   | 0.9791    |
| 0.0391        | 32.22 | 1740 | 0.0690          | 0.7007   | 0.7676        | 0.9766           | nan                | 0.9557        | 0.7667             | 0.8654       | 0.8402              | 0.1874        | 0.9902         | nan           | 0.9044   | 0.6447        | 0.7851  | 0.7129         | 0.1775   | 0.9793    |
| 0.0834        | 32.59 | 1760 | 0.0688          | 0.7015   | 0.7699        | 0.9768           | nan                | 0.9519        | 0.7571             | 0.8926       | 0.8319              | 0.1954        | 0.9907         | nan           | 0.9048   | 0.6459        | 0.7860  | 0.7089         | 0.1840   | 0.9795    |
| 0.0412        | 32.96 | 1780 | 0.0694          | 0.7080   | 0.7786        | 0.9768           | nan                | 0.9560        | 0.7600             | 0.8859       | 0.8386              | 0.2410        | 0.9901         | nan           | 0.9077   | 0.6464        | 0.7894  | 0.7049         | 0.2203   | 0.9791    |
| 0.0476        | 33.33 | 1800 | 0.0698          | 0.7045   | 0.7689        | 0.9766           | nan                | 0.9582        | 0.7688             | 0.8677       | 0.8225              | 0.2062        | 0.9900         | nan           | 0.9055   | 0.6537        | 0.7854  | 0.7090         | 0.1948   | 0.9788    |
| 0.0407        | 33.7  | 1820 | 0.0684          | 0.7103   | 0.7824        | 0.9770           | nan                | 0.9535        | 0.7700             | 0.8809       | 0.8575              | 0.2423        | 0.9904         | nan           | 0.9077   | 0.6555        | 0.7885  | 0.7073         | 0.2233   | 0.9794    |
| 0.0307        | 34.07 | 1840 | 0.0717          | 0.7072   | 0.7902        | 0.9755           | nan                | 0.9608        | 0.7869             | 0.8959       | 0.8623              | 0.2484        | 0.9867         | nan           | 0.9000   | 0.6421        | 0.7882  | 0.7089         | 0.2258   | 0.9781    |
| 0.0236        | 34.44 | 1860 | 0.0700          | 0.7104   | 0.7889        | 0.9765           | nan                | 0.9502        | 0.7737             | 0.8754       | 0.8807              | 0.2639        | 0.9900         | nan           | 0.9041   | 0.6532        | 0.7850  | 0.7041         | 0.2370   | 0.9791    |
| 0.0752        | 34.81 | 1880 | 0.0689          | 0.7068   | 0.7716        | 0.9766           | nan                | 0.9564        | 0.7689             | 0.8845       | 0.8157              | 0.2139        | 0.9899         | nan           | 0.9032   | 0.6542        | 0.7915  | 0.7115         | 0.2012   | 0.9790    |
| 0.0301        | 35.19 | 1900 | 0.0701          | 0.7021   | 0.7862        | 0.9761           | nan                | 0.9427        | 0.8005             | 0.8935       | 0.8702              | 0.2209        | 0.9896         | nan           | 0.9046   | 0.6342        | 0.7870  | 0.7013         | 0.2064   | 0.9793    |
| 0.0457        | 35.56 | 1920 | 0.0694          | 0.7053   | 0.7683        | 0.9769           | nan                | 0.9525        | 0.7313             | 0.8720       | 0.8319              | 0.2302        | 0.9918         | nan           | 0.9053   | 0.6363        | 0.7872  | 0.7100         | 0.2136   | 0.9796    |
| 0.033         | 35.93 | 1940 | 0.0695          | 0.7078   | 0.7745        | 0.9766           | nan                | 0.9618        | 0.7552             | 0.8873       | 0.8138              | 0.2392        | 0.9894         | nan           | 0.9037   | 0.6423        | 0.7926  | 0.7104         | 0.2183   | 0.9793    |
| 0.0231        | 36.3  | 1960 | 0.0687          | 0.7060   | 0.7741        | 0.9769           | nan                | 0.9493        | 0.7574             | 0.8883       | 0.8302              | 0.2284        | 0.9912         | nan           | 0.9052   | 0.6403        | 0.7898  | 0.7092         | 0.2118   | 0.9798    |
| 0.038         | 36.67 | 1980 | 0.0685          | 0.7082   | 0.7775        | 0.9767           | nan                | 0.9640        | 0.7617             | 0.8762       | 0.8311              | 0.2431        | 0.9891         | nan           | 0.9042   | 0.6457        | 0.7927  | 0.7064         | 0.2206   | 0.9795    |
| 0.0421        | 37.04 | 2000 | 0.0684          | 0.7083   | 0.7806        | 0.9767           | nan                | 0.9523        | 0.7679             | 0.8937       | 0.8367              | 0.2427        | 0.9902         | nan           | 0.9048   | 0.6430        | 0.7934  | 0.7069         | 0.2222   | 0.9796    |
| 0.0431        | 37.41 | 2020 | 0.0700          | 0.7097   | 0.7792        | 0.9763           | nan                | 0.9580        | 0.7520             | 0.8796       | 0.8316              | 0.2641        | 0.9896         | nan           | 0.9019   | 0.6332        | 0.7909  | 0.7144         | 0.2385   | 0.9793    |
| 0.0384        | 37.78 | 2040 | 0.0671          | 0.7123   | 0.7770        | 0.9774           | nan                | 0.9580        | 0.7566             | 0.8859       | 0.8268              | 0.2441        | 0.9908         | nan           | 0.9085   | 0.6542        | 0.7907  | 0.7163         | 0.2242   | 0.9799    |
| 0.0405        | 38.15 | 2060 | 0.0672          | 0.7141   | 0.7884        | 0.9772           | nan                | 0.9559        | 0.7886             | 0.8953       | 0.8413              | 0.2596        | 0.9895         | nan           | 0.9092   | 0.6515        | 0.7949  | 0.7149         | 0.2345   | 0.9797    |
| 0.0474        | 38.52 | 2080 | 0.0677          | 0.7122   | 0.7779        | 0.9773           | nan                | 0.9611        | 0.7538             | 0.8965       | 0.8228              | 0.2431        | 0.9901         | nan           | 0.9072   | 0.6535        | 0.7946  | 0.7159         | 0.2224   | 0.9798    |
| 0.0862        | 38.89 | 2100 | 0.0682          | 0.7115   | 0.7787        | 0.9772           | nan                | 0.9539        | 0.7524             | 0.8878       | 0.8352              | 0.2516        | 0.9910         | nan           | 0.9073   | 0.6464        | 0.7929  | 0.7136         | 0.2290   | 0.9798    |
| 0.0354        | 39.26 | 2120 | 0.0677          | 0.7085   | 0.7713        | 0.9772           | nan                | 0.9562        | 0.7498             | 0.8778       | 0.8236              | 0.2290        | 0.9912         | nan           | 0.9084   | 0.6464        | 0.7894  | 0.7146         | 0.2127   | 0.9796    |
| 0.0549        | 39.63 | 2140 | 0.0686          | 0.7079   | 0.7702        | 0.9768           | nan                | 0.9573        | 0.7483             | 0.8772       | 0.8090              | 0.2386        | 0.9907         | nan           | 0.9060   | 0.6389        | 0.7896  | 0.7132         | 0.2204   | 0.9794    |
| 0.0355        | 40.0  | 2160 | 0.0688          | 0.7131   | 0.7845        | 0.9768           | nan                | 0.9595        | 0.7532             | 0.8882       | 0.8417              | 0.2747        | 0.9896         | nan           | 0.9049   | 0.6461        | 0.7936  | 0.7110         | 0.2441   | 0.9793    |
| 2.1231        | 40.37 | 2180 | 0.0676          | 0.7069   | 0.7721        | 0.9769           | nan                | 0.9521        | 0.7665             | 0.8752       | 0.8309              | 0.2170        | 0.9910         | nan           | 0.9060   | 0.6463        | 0.7894  | 0.7156         | 0.2044   | 0.9796    |
| 0.0577        | 40.74 | 2200 | 0.0669          | 0.7129   | 0.7797        | 0.9774           | nan                | 0.9582        | 0.7679             | 0.8834       | 0.8338              | 0.2445        | 0.9904         | nan           | 0.9097   | 0.6600        | 0.7920  | 0.7108         | 0.2256   | 0.9796    |
| 0.0318        | 41.11 | 2220 | 0.0676          | 0.7131   | 0.7817        | 0.9771           | nan                | 0.9615        | 0.7636             | 0.8916       | 0.8335              | 0.2504        | 0.9895         | nan           | 0.9067   | 0.6543        | 0.7943  | 0.7147         | 0.2292   | 0.9795    |
| 0.0356        | 41.48 | 2240 | 0.0674          | 0.7167   | 0.7861        | 0.9773           | nan                | 0.9582        | 0.7643             | 0.8956       | 0.8287              | 0.2800        | 0.9900         | nan           | 0.9076   | 0.6530        | 0.7965  | 0.7154         | 0.2479   | 0.9797    |
| 0.0816        | 41.85 | 2260 | 0.0676          | 0.7126   | 0.7728        | 0.9774           | nan                | 0.9568        | 0.7636             | 0.8714       | 0.8100              | 0.2439        | 0.9912         | nan           | 0.9090   | 0.6544        | 0.7924  | 0.7146         | 0.2254   | 0.9797    |
| 0.0561        | 42.22 | 2280 | 0.0666          | 0.7130   | 0.7759        | 0.9775           | nan                | 0.9537        | 0.7694             | 0.8763       | 0.8244              | 0.2400        | 0.9914         | nan           | 0.9092   | 0.6624        | 0.7912  | 0.7133         | 0.2222   | 0.9797    |
| 0.0336        | 42.59 | 2300 | 0.0669          | 0.7173   | 0.7858        | 0.9776           | nan                | 0.9553        | 0.7755             | 0.8866       | 0.8381              | 0.2685        | 0.9907         | nan           | 0.9095   | 0.6654        | 0.7936  | 0.7138         | 0.2419   | 0.9798    |
| 0.0313        | 42.96 | 2320 | 0.0669          | 0.7119   | 0.7773        | 0.9775           | nan                | 0.9560        | 0.7609             | 0.8968       | 0.8289              | 0.2304        | 0.9907         | nan           | 0.9084   | 0.6581        | 0.7945  | 0.7150         | 0.2154   | 0.9798    |
| 0.0611        | 43.33 | 2340 | 0.0670          | 0.7090   | 0.7756        | 0.9772           | nan                | 0.9547        | 0.7711             | 0.8810       | 0.8347              | 0.2215        | 0.9907         | nan           | 0.9071   | 0.6520        | 0.7914  | 0.7153         | 0.2082   | 0.9798    |
| 0.0329        | 43.7  | 2360 | 0.0669          | 0.7146   | 0.7803        | 0.9775           | nan                | 0.9577        | 0.7647             | 0.8782       | 0.8346              | 0.2555        | 0.9908         | nan           | 0.9091   | 0.6560        | 0.7926  | 0.7162         | 0.2337   | 0.9800    |
| 0.0528        | 44.07 | 2380 | 0.0668          | 0.7131   | 0.7721        | 0.9776           | nan                | 0.9594        | 0.7513             | 0.8762       | 0.8097              | 0.2449        | 0.9913         | nan           | 0.9087   | 0.6565        | 0.7923  | 0.7147         | 0.2262   | 0.9799    |
| 0.0729        | 44.44 | 2400 | 0.0671          | 0.7131   | 0.7748        | 0.9775           | nan                | 0.9578        | 0.7573             | 0.8777       | 0.8187              | 0.2461        | 0.9911         | nan           | 0.9085   | 0.6566        | 0.7912  | 0.7152         | 0.2272   | 0.9798    |
| 0.0383        | 44.81 | 2420 | 0.0675          | 0.7108   | 0.7809        | 0.9771           | nan                | 0.9506        | 0.7742             | 0.8796       | 0.8459              | 0.2443        | 0.9909         | nan           | 0.9072   | 0.6499        | 0.7903  | 0.7116         | 0.2262   | 0.9798    |
| 0.0565        | 45.19 | 2440 | 0.0674          | 0.7154   | 0.7821        | 0.9774           | nan                | 0.9590        | 0.7609             | 0.8808       | 0.8296              | 0.2720        | 0.9905         | nan           | 0.9086   | 0.6546        | 0.7931  | 0.7129         | 0.2436   | 0.9797    |
| 0.0417        | 45.56 | 2460 | 0.0671          | 0.7149   | 0.7809        | 0.9776           | nan                | 0.9563        | 0.7631             | 0.8843       | 0.8383              | 0.2524        | 0.9909         | nan           | 0.9095   | 0.6570        | 0.7939  | 0.7174         | 0.2314   | 0.9799    |
| 0.024         | 45.93 | 2480 | 0.0678          | 0.7159   | 0.7872        | 0.9772           | nan                | 0.9564        | 0.7709             | 0.8828       | 0.8458              | 0.2769        | 0.9902         | nan           | 0.9074   | 0.6549        | 0.7927  | 0.7148         | 0.2458   | 0.9797    |
| 0.0496        | 46.3  | 2500 | 0.0668          | 0.7148   | 0.7836        | 0.9775           | nan                | 0.9554        | 0.7648             | 0.8905       | 0.8390              | 0.2614        | 0.9907         | nan           | 0.9092   | 0.6567        | 0.7931  | 0.7131         | 0.2368   | 0.9799    |
| 0.0428        | 46.67 | 2520 | 0.0668          | 0.7150   | 0.7857        | 0.9773           | nan                | 0.9571        | 0.7641             | 0.8969       | 0.8438              | 0.2624        | 0.9902         | nan           | 0.9083   | 0.6559        | 0.7941  | 0.7144         | 0.2372   | 0.9798    |
| 0.0458        | 47.04 | 2540 | 0.0665          | 0.7141   | 0.7811        | 0.9775           | nan                | 0.9540        | 0.7665             | 0.8957       | 0.8351              | 0.2443        | 0.9908         | nan           | 0.9088   | 0.6565        | 0.7946  | 0.7192         | 0.2257   | 0.9799    |
| 0.0429        | 47.41 | 2560 | 0.0673          | 0.7131   | 0.7791        | 0.9773           | nan                | 0.9604        | 0.7621             | 0.8836       | 0.8325              | 0.2457        | 0.9901         | nan           | 0.9073   | 0.6536        | 0.7936  | 0.7180         | 0.2266   | 0.9797    |
| 0.0449        | 47.78 | 2580 | 0.0666          | 0.7144   | 0.7786        | 0.9775           | nan                | 0.9571        | 0.7630             | 0.8873       | 0.8248              | 0.2484        | 0.9908         | nan           | 0.9089   | 0.6565        | 0.7944  | 0.7188         | 0.2281   | 0.9799    |
| 0.0302        | 48.15 | 2600 | 0.0665          | 0.7155   | 0.7800        | 0.9776           | nan                | 0.9552        | 0.7637             | 0.8904       | 0.8251              | 0.2545        | 0.9911         | nan           | 0.9094   | 0.6580        | 0.7936  | 0.7196         | 0.2326   | 0.9799    |
| 0.029         | 48.52 | 2620 | 0.0675          | 0.7176   | 0.7877        | 0.9774           | nan                | 0.9588        | 0.7640             | 0.8947       | 0.8445              | 0.2744        | 0.9901         | nan           | 0.9081   | 0.6575        | 0.7948  | 0.7204         | 0.2447   | 0.9798    |
| 1.9447        | 48.89 | 2640 | 0.0662          | 0.7130   | 0.7803        | 0.9774           | nan                | 0.9529        | 0.7688             | 0.8720       | 0.8497              | 0.2471        | 0.9912         | nan           | 0.9085   | 0.6550        | 0.7904  | 0.7170         | 0.2272   | 0.9799    |
| 0.0247        | 49.26 | 2660 | 0.0674          | 0.7163   | 0.7870        | 0.9773           | nan                | 0.9593        | 0.7720             | 0.8815       | 0.8486              | 0.2704        | 0.9899         | nan           | 0.9077   | 0.6575        | 0.7928  | 0.7181         | 0.2422   | 0.9797    |
| 0.0369        | 49.63 | 2680 | 0.0662          | 0.7154   | 0.7839        | 0.9775           | nan                | 0.9547        | 0.7711             | 0.8850       | 0.8430              | 0.2588        | 0.9907         | nan           | 0.9087   | 0.6571        | 0.7934  | 0.7181         | 0.2354   | 0.9799    |
| 0.0317        | 50.0  | 2700 | 0.0665          | 0.7168   | 0.7840        | 0.9775           | nan                | 0.9559        | 0.7693             | 0.8882       | 0.8345              | 0.2653        | 0.9907         | nan           | 0.9088   | 0.6583        | 0.7943  | 0.7201         | 0.2393   | 0.9799    |


### Framework versions

- Transformers 4.36.2
- Pytorch 2.1.2+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
