transformers safetensors segformer vision image-segmentation generated_from_trainer base_model:nvidia/mit-b0 license:other endpoints_compatible region:us
---
license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b0-finetuned-segments-sidewalk-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b0-finetuned-segments-sidewalk-2

This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the jhaberbe/lipid-droplets dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0550
- Mean Iou: 0.4255
- Mean Accuracy: 0.8510
- Overall Accuracy: 0.8510
- Accuracy Unlabeled: nan
- Accuracy Lipid: 0.8510
- Iou Unlabeled: 0.0
- Iou Lipid: 0.8510

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 500

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Lipid | Iou Unlabeled | Iou Lipid |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:--------------:|:-------------:|:---------:|
| 0.0516        | 2.5   | 20   | 0.0743          | 0.0034   | 0.0068        | 0.0068           | nan                | 0.0068         | 0.0           | 0.0068    |
| 0.0349        | 5.0   | 40   | 0.0308          | 0.0      | 0.0           | 0.0              | nan                | 0.0            | 0.0           | 0.0       |
| 0.0325        | 7.5   | 60   | 0.1740          | 0.0820   | 0.1640        | 0.1640           | nan                | 0.1640         | 0.0           | 0.1640    |
| 0.0543        | 10.0  | 80   | 0.0901          | 0.0395   | 0.0791        | 0.0791           | nan                | 0.0791         | 0.0           | 0.0791    |
| 0.026         | 12.5  | 100  | 0.0796          | 0.0472   | 0.0943        | 0.0943           | nan                | 0.0943         | 0.0           | 0.0943    |
| 0.0188        | 15.0  | 120  | 0.0522          | 0.0428   | 0.0855        | 0.0855           | nan                | 0.0855         | 0.0           | 0.0855    |
| 0.0245        | 17.5  | 140  | 0.1580          | 0.2788   | 0.5576        | 0.5576           | nan                | 0.5576         | 0.0           | 0.5576    |
| 0.0191        | 20.0  | 160  | 0.1044          | 0.1776   | 0.3551        | 0.3551           | nan                | 0.3551         | 0.0           | 0.3551    |
| 0.0191        | 22.5  | 180  | 0.1680          | 0.2733   | 0.5467        | 0.5467           | nan                | 0.5467         | 0.0           | 0.5467    |
| 0.0192        | 25.0  | 200  | 0.1560          | 0.2549   | 0.5098        | 0.5098           | nan                | 0.5098         | 0.0           | 0.5098    |
| 0.012         | 27.5  | 220  | 0.1381          | 0.2477   | 0.4955        | 0.4955           | nan                | 0.4955         | 0.0           | 0.4955    |
| 0.0119        | 30.0  | 240  | 0.1454          | 0.3042   | 0.6084        | 0.6084           | nan                | 0.6084         | 0.0           | 0.6084    |
| 0.0193        | 32.5  | 260  | 0.0829          | 0.2021   | 0.4043        | 0.4043           | nan                | 0.4043         | 0.0           | 0.4043    |
| 0.0088        | 35.0  | 280  | 0.1286          | 0.2576   | 0.5151        | 0.5151           | nan                | 0.5151         | 0.0           | 0.5151    |
| 0.0198        | 37.5  | 300  | 0.0757          | 0.2336   | 0.4671        | 0.4671           | nan                | 0.4671         | 0.0           | 0.4671    |
| 0.0124        | 40.0  | 320  | 0.1081          | 0.2516   | 0.5032        | 0.5032           | nan                | 0.5032         | 0.0           | 0.5032    |
| 0.0348        | 42.5  | 340  | 0.1083          | 0.3188   | 0.6377        | 0.6377           | nan                | 0.6377         | 0.0           | 0.6377    |
| 0.0083        | 45.0  | 360  | 0.0434          | 0.2969   | 0.5939        | 0.5939           | nan                | 0.5939         | 0.0           | 0.5939    |
| 0.0135        | 47.5  | 380  | 0.0343          | 0.0148   | 0.0296        | 0.0296           | nan                | 0.0296         | 0.0           | 0.0296    |
| 0.0062        | 50.0  | 400  | 0.1240          | 0.3299   | 0.6598        | 0.6598           | nan                | 0.6598         | 0.0           | 0.6598    |
| 0.0075        | 52.5  | 420  | 0.0793          | 0.3017   | 0.6033        | 0.6033           | nan                | 0.6033         | 0.0           | 0.6033    |
| 0.007         | 55.0  | 440  | 0.0958          | 0.4086   | 0.8173        | 0.8173           | nan                | 0.8173         | 0.0           | 0.8173    |
| 0.0071        | 57.5  | 460  | 0.0204          | 0.1870   | 0.3741        | 0.3741           | nan                | 0.3741         | 0.0           | 0.3741    |
| 0.0071        | 60.0  | 480  | 0.0971          | 0.4326   | 0.8652        | 0.8652           | nan                | 0.8652         | 0.0           | 0.8652    |
| 0.0107        | 62.5  | 500  | 0.1058          | 0.4312   | 0.8624        | 0.8624           | nan                | 0.8624         | 0.0           | 0.8624    |
| 0.0033        | 65.0  | 520  | 0.1208          | 0.4278   | 0.8557        | 0.8557           | nan                | 0.8557         | 0.0           | 0.8557    |
| 0.0071        | 67.5  | 540  | 0.1153          | 0.3516   | 0.7032        | 0.7032           | nan                | 0.7032         | 0.0           | 0.7032    |
| 0.0055        | 70.0  | 560  | 0.1756          | 0.4550   | 0.9099        | 0.9099           | nan                | 0.9099         | 0.0           | 0.9099    |
| 0.0114        | 72.5  | 580  | 0.1491          | 0.4353   | 0.8706        | 0.8706           | nan                | 0.8706         | 0.0           | 0.8706    |
| 0.008         | 75.0  | 600  | 0.2018          | 0.4520   | 0.9041        | 0.9041           | nan                | 0.9041         | 0.0           | 0.9041    |
| 0.0037        | 77.5  | 620  | 0.0842          | 0.2597   | 0.5195        | 0.5195           | nan                | 0.5195         | 0.0           | 0.5195    |
| 0.0079        | 80.0  | 640  | 0.1237          | 0.3507   | 0.7013        | 0.7013           | nan                | 0.7013         | 0.0           | 0.7013    |
| 0.0064        | 82.5  | 660  | 0.1580          | 0.4599   | 0.9199        | 0.9199           | nan                | 0.9199         | 0.0           | 0.9199    |
| 0.0102        | 85.0  | 680  | 0.1675          | 0.4474   | 0.8947        | 0.8947           | nan                | 0.8947         | 0.0           | 0.8947    |
| 0.0034        | 87.5  | 700  | 0.1346          | 0.4061   | 0.8122        | 0.8122           | nan                | 0.8122         | 0.0           | 0.8122    |
| 0.0052        | 90.0  | 720  | 0.1353          | 0.3878   | 0.7757        | 0.7757           | nan                | 0.7757         | 0.0           | 0.7757    |
| 0.0078        | 92.5  | 740  | 0.1522          | 0.4156   | 0.8312        | 0.8312           | nan                | 0.8312         | 0.0           | 0.8312    |
| 0.0072        | 95.0  | 760  | 0.0946          | 0.3724   | 0.7449        | 0.7449           | nan                | 0.7449         | 0.0           | 0.7449    |
| 0.0056        | 97.5  | 780  | 0.1443          | 0.3535   | 0.7071        | 0.7071           | nan                | 0.7071         | 0.0           | 0.7071    |
| 0.0025        | 100.0 | 800  | 0.0505          | 0.2453   | 0.4906        | 0.4906           | nan                | 0.4906         | 0.0           | 0.4906    |
| 0.0054        | 102.5 | 820  | 0.0572          | 0.3087   | 0.6174        | 0.6174           | nan                | 0.6174         | 0.0           | 0.6174    |
| 0.0041        | 105.0 | 840  | 0.0329          | 0.3713   | 0.7425        | 0.7425           | nan                | 0.7425         | 0.0           | 0.7425    |
| 0.0109        | 107.5 | 860  | 0.0145          | 0.0508   | 0.1016        | 0.1016           | nan                | 0.1016         | 0.0           | 0.1016    |
| 0.007         | 110.0 | 880  | 0.0777          | 0.3226   | 0.6453        | 0.6453           | nan                | 0.6453         | 0.0           | 0.6453    |
| 0.0083        | 112.5 | 900  | 0.0207          | 0.0628   | 0.1256        | 0.1256           | nan                | 0.1256         | 0.0           | 0.1256    |
| 0.0097        | 115.0 | 920  | 0.0277          | 0.0798   | 0.1596        | 0.1596           | nan                | 0.1596         | 0.0           | 0.1596    |
| 0.0072        | 117.5 | 940  | 0.0855          | 0.4426   | 0.8853        | 0.8853           | nan                | 0.8853         | 0.0           | 0.8853    |
| 0.012         | 120.0 | 960  | 0.0892          | 0.4119   | 0.8238        | 0.8238           | nan                | 0.8238         | 0.0           | 0.8238    |
| 0.0051        | 122.5 | 980  | 0.1283          | 0.4709   | 0.9418        | 0.9418           | nan                | 0.9418         | 0.0           | 0.9418    |
| 0.0077        | 125.0 | 1000 | 0.0457          | 0.2912   | 0.5825        | 0.5825           | nan                | 0.5825         | 0.0           | 0.5825    |
| 0.0034        | 127.5 | 1020 | 0.1691          | 0.4538   | 0.9075        | 0.9075           | nan                | 0.9075         | 0.0           | 0.9075    |
| 0.0122        | 130.0 | 1040 | 0.1461          | 0.4322   | 0.8645        | 0.8645           | nan                | 0.8645         | 0.0           | 0.8645    |
| 0.0114        | 132.5 | 1060 | 0.0897          | 0.4222   | 0.8443        | 0.8443           | nan                | 0.8443         | 0.0           | 0.8443    |
| 0.0032        | 135.0 | 1080 | 0.0840          | 0.4068   | 0.8135        | 0.8135           | nan                | 0.8135         | 0.0           | 0.8135    |
| 0.0018        | 137.5 | 1100 | 0.0703          | 0.3818   | 0.7636        | 0.7636           | nan                | 0.7636         | 0.0           | 0.7636    |
| 0.007         | 140.0 | 1120 | 0.0540          | 0.3854   | 0.7707        | 0.7707           | nan                | 0.7707         | 0.0           | 0.7707    |
| 0.0033        | 142.5 | 1140 | 0.1461          | 0.4680   | 0.9360        | 0.9360           | nan                | 0.9360         | 0.0           | 0.9360    |
| 0.0053        | 145.0 | 1160 | 0.0881          | 0.4246   | 0.8492        | 0.8492           | nan                | 0.8492         | 0.0           | 0.8492    |
| 0.0021        | 147.5 | 1180 | 0.1465          | 0.4431   | 0.8862        | 0.8862           | nan                | 0.8862         | 0.0           | 0.8862    |
| 0.004         | 150.0 | 1200 | 0.0908          | 0.3682   | 0.7364        | 0.7364           | nan                | 0.7364         | 0.0           | 0.7364    |
| 0.0055        | 152.5 | 1220 | 0.0143          | 0.2918   | 0.5835        | 0.5835           | nan                | 0.5835         | 0.0           | 0.5835    |
| 0.0071        | 155.0 | 1240 | 0.0314          | 0.3678   | 0.7357        | 0.7357           | nan                | 0.7357         | 0.0           | 0.7357    |
| 0.0042        | 157.5 | 1260 | 0.0962          | 0.4116   | 0.8232        | 0.8232           | nan                | 0.8232         | 0.0           | 0.8232    |
| 0.0035        | 160.0 | 1280 | 0.0958          | 0.4412   | 0.8824        | 0.8824           | nan                | 0.8824         | 0.0           | 0.8824    |
| 0.0045        | 162.5 | 1300 | 0.1473          | 0.4577   | 0.9153        | 0.9153           | nan                | 0.9153         | 0.0           | 0.9153    |
| 0.008         | 165.0 | 1320 | 0.0537          | 0.4320   | 0.8639        | 0.8639           | nan                | 0.8639         | 0.0           | 0.8639    |
| 0.005         | 167.5 | 1340 | 0.1155          | 0.4133   | 0.8265        | 0.8265           | nan                | 0.8265         | 0.0           | 0.8265    |
| 0.0052        | 170.0 | 1360 | 0.0997          | 0.4201   | 0.8402        | 0.8402           | nan                | 0.8402         | 0.0           | 0.8402    |
| 0.0034        | 172.5 | 1380 | 0.1630          | 0.4693   | 0.9386        | 0.9386           | nan                | 0.9386         | 0.0           | 0.9386    |
| 0.0052        | 175.0 | 1400 | 0.1317          | 0.4719   | 0.9437        | 0.9437           | nan                | 0.9437         | 0.0           | 0.9437    |
| 0.0074        | 177.5 | 1420 | 0.0829          | 0.4105   | 0.8210        | 0.8210           | nan                | 0.8210         | 0.0           | 0.8210    |
| 0.0028        | 180.0 | 1440 | 0.0844          | 0.4172   | 0.8345        | 0.8345           | nan                | 0.8345         | 0.0           | 0.8345    |
| 0.0058        | 182.5 | 1460 | 0.0435          | 0.4035   | 0.8069        | 0.8069           | nan                | 0.8069         | 0.0           | 0.8069    |
| 0.0016        | 185.0 | 1480 | 0.0738          | 0.3716   | 0.7432        | 0.7432           | nan                | 0.7432         | 0.0           | 0.7432    |
| 0.0042        | 187.5 | 1500 | 0.0720          | 0.4293   | 0.8586        | 0.8586           | nan                | 0.8586         | 0.0           | 0.8586    |
| 0.0054        | 190.0 | 1520 | 0.1118          | 0.4383   | 0.8765        | 0.8765           | nan                | 0.8765         | 0.0           | 0.8765    |
| 0.0029        | 192.5 | 1540 | 0.0983          | 0.4670   | 0.9341        | 0.9341           | nan                | 0.9341         | 0.0           | 0.9341    |
| 0.0058        | 195.0 | 1560 | 0.1428          | 0.4736   | 0.9472        | 0.9472           | nan                | 0.9472         | 0.0           | 0.9472    |
| 0.002         | 197.5 | 1580 | 0.0342          | 0.4120   | 0.8240        | 0.8240           | nan                | 0.8240         | 0.0           | 0.8240    |
| 0.0159        | 200.0 | 1600 | 0.0726          | 0.4483   | 0.8966        | 0.8966           | nan                | 0.8966         | 0.0           | 0.8966    |
| 0.0039        | 202.5 | 1620 | 0.0517          | 0.3259   | 0.6519        | 0.6519           | nan                | 0.6519         | 0.0           | 0.6519    |
| 0.0063        | 205.0 | 1640 | 0.0964          | 0.4086   | 0.8171        | 0.8171           | nan                | 0.8171         | 0.0           | 0.8171    |
| 0.0057        | 207.5 | 1660 | 0.0325          | 0.2521   | 0.5043        | 0.5043           | nan                | 0.5043         | 0.0           | 0.5043    |
| 0.0041        | 210.0 | 1680 | 0.0323          | 0.4040   | 0.8081        | 0.8081           | nan                | 0.8081         | 0.0           | 0.8081    |
| 0.0036        | 212.5 | 1700 | 0.1222          | 0.4657   | 0.9315        | 0.9315           | nan                | 0.9315         | 0.0           | 0.9315    |
| 0.0052        | 215.0 | 1720 | 0.0984          | 0.4187   | 0.8375        | 0.8375           | nan                | 0.8375         | 0.0           | 0.8375    |
| 0.0031        | 217.5 | 1740 | 0.0806          | 0.4095   | 0.8190        | 0.8190           | nan                | 0.8190         | 0.0           | 0.8190    |
| 0.0053        | 220.0 | 1760 | 0.0750          | 0.3251   | 0.6503        | 0.6503           | nan                | 0.6503         | 0.0           | 0.6503    |
| 0.0016        | 222.5 | 1780 | 0.0943          | 0.3690   | 0.7380        | 0.7380           | nan                | 0.7380         | 0.0           | 0.7380    |
| 0.0014        | 225.0 | 1800 | 0.0832          | 0.3781   | 0.7562        | 0.7562           | nan                | 0.7562         | 0.0           | 0.7562    |
| 0.0016        | 227.5 | 1820 | 0.0583          | 0.4524   | 0.9048        | 0.9048           | nan                | 0.9048         | 0.0           | 0.9048    |
| 0.0059        | 230.0 | 1840 | 0.0812          | 0.4081   | 0.8162        | 0.8162           | nan                | 0.8162         | 0.0           | 0.8162    |
| 0.0039        | 232.5 | 1860 | 0.0915          | 0.3669   | 0.7337        | 0.7337           | nan                | 0.7337         | 0.0           | 0.7337    |
| 0.0065        | 235.0 | 1880 | 0.0144          | 0.2502   | 0.5004        | 0.5004           | nan                | 0.5004         | 0.0           | 0.5004    |
| 0.0036        | 237.5 | 1900 | 0.0905          | 0.4684   | 0.9369        | 0.9369           | nan                | 0.9369         | 0.0           | 0.9369    |
| 0.0027        | 240.0 | 1920 | 0.0926          | 0.4087   | 0.8174        | 0.8174           | nan                | 0.8174         | 0.0           | 0.8174    |
| 0.0027        | 242.5 | 1940 | 0.0670          | 0.4460   | 0.8920        | 0.8920           | nan                | 0.8920         | 0.0           | 0.8920    |
| 0.0028        | 245.0 | 1960 | 0.0950          | 0.4656   | 0.9312        | 0.9312           | nan                | 0.9312         | 0.0           | 0.9312    |
| 0.0025        | 247.5 | 1980 | 0.1178          | 0.4315   | 0.8630        | 0.8630           | nan                | 0.8630         | 0.0           | 0.8630    |
| 0.0028        | 250.0 | 2000 | 0.0963          | 0.3941   | 0.7882        | 0.7882           | nan                | 0.7882         | 0.0           | 0.7882    |
| 0.0016        | 252.5 | 2020 | 0.0682          | 0.4172   | 0.8344        | 0.8344           | nan                | 0.8344         | 0.0           | 0.8344    |
| 0.002         | 255.0 | 2040 | 0.0760          | 0.4218   | 0.8437        | 0.8437           | nan                | 0.8437         | 0.0           | 0.8437    |
| 0.0011        | 257.5 | 2060 | 0.0649          | 0.3866   | 0.7732        | 0.7732           | nan                | 0.7732         | 0.0           | 0.7732    |
| 0.0038        | 260.0 | 2080 | 0.0962          | 0.4099   | 0.8198        | 0.8198           | nan                | 0.8198         | 0.0           | 0.8198    |
| 0.0071        | 262.5 | 2100 | 0.0638          | 0.4079   | 0.8159        | 0.8159           | nan                | 0.8159         | 0.0           | 0.8159    |
| 0.0029        | 265.0 | 2120 | 0.0356          | 0.3062   | 0.6125        | 0.6125           | nan                | 0.6125         | 0.0           | 0.6125    |
| 0.0013        | 267.5 | 2140 | 0.0410          | 0.3779   | 0.7558        | 0.7558           | nan                | 0.7558         | 0.0           | 0.7558    |
| 0.0061        | 270.0 | 2160 | 0.0985          | 0.4085   | 0.8169        | 0.8169           | nan                | 0.8169         | 0.0           | 0.8169    |
| 0.001         | 272.5 | 2180 | 0.0520          | 0.3867   | 0.7734        | 0.7734           | nan                | 0.7734         | 0.0           | 0.7734    |
| 0.0035        | 275.0 | 2200 | 0.0777          | 0.4045   | 0.8090        | 0.8090           | nan                | 0.8090         | 0.0           | 0.8090    |
| 0.0037        | 277.5 | 2220 | 0.0407          | 0.3915   | 0.7830        | 0.7830           | nan                | 0.7830         | 0.0           | 0.7830    |
| 0.0045        | 280.0 | 2240 | 0.0780          | 0.4407   | 0.8814        | 0.8814           | nan                | 0.8814         | 0.0           | 0.8814    |
| 0.0026        | 282.5 | 2260 | 0.0606          | 0.4039   | 0.8078        | 0.8078           | nan                | 0.8078         | 0.0           | 0.8078    |
| 0.0034        | 285.0 | 2280 | 0.0820          | 0.4020   | 0.8039        | 0.8039           | nan                | 0.8039         | 0.0           | 0.8039    |
| 0.0039        | 287.5 | 2300 | 0.0842          | 0.4458   | 0.8915        | 0.8915           | nan                | 0.8915         | 0.0           | 0.8915    |
| 0.0007        | 290.0 | 2320 | 0.0296          | 0.3628   | 0.7257        | 0.7257           | nan                | 0.7257         | 0.0           | 0.7257    |
| 0.0051        | 292.5 | 2340 | 0.0728          | 0.4366   | 0.8732        | 0.8732           | nan                | 0.8732         | 0.0           | 0.8732    |
| 0.001         | 295.0 | 2360 | 0.0337          | 0.3528   | 0.7056        | 0.7056           | nan                | 0.7056         | 0.0           | 0.7056    |
| 0.0015        | 297.5 | 2380 | 0.1415          | 0.4762   | 0.9524        | 0.9524           | nan                | 0.9524         | 0.0           | 0.9524    |
| 0.0047        | 300.0 | 2400 | 0.0607          | 0.4035   | 0.8070        | 0.8070           | nan                | 0.8070         | 0.0           | 0.8070    |
| 0.0022        | 302.5 | 2420 | 0.0882          | 0.4462   | 0.8924        | 0.8924           | nan                | 0.8924         | 0.0           | 0.8924    |
| 0.001         | 305.0 | 2440 | 0.0629          | 0.4151   | 0.8303        | 0.8303           | nan                | 0.8303         | 0.0           | 0.8303    |
| 0.0028        | 307.5 | 2460 | 0.0676          | 0.4447   | 0.8895        | 0.8895           | nan                | 0.8895         | 0.0           | 0.8895    |
| 0.0009        | 310.0 | 2480 | 0.0947          | 0.4772   | 0.9544        | 0.9544           | nan                | 0.9544         | 0.0           | 0.9544    |
| 0.0025        | 312.5 | 2500 | 0.0736          | 0.4609   | 0.9218        | 0.9218           | nan                | 0.9218         | 0.0           | 0.9218    |
| 0.0049        | 315.0 | 2520 | 0.0672          | 0.4460   | 0.8919        | 0.8919           | nan                | 0.8919         | 0.0           | 0.8919    |
| 0.0045        | 317.5 | 2540 | 0.1001          | 0.4477   | 0.8954        | 0.8954           | nan                | 0.8954         | 0.0           | 0.8954    |
| 0.0014        | 320.0 | 2560 | 0.1098          | 0.4330   | 0.8661        | 0.8661           | nan                | 0.8661         | 0.0           | 0.8661    |
| 0.0048        | 322.5 | 2580 | 0.0952          | 0.4472   | 0.8945        | 0.8945           | nan                | 0.8945         | 0.0           | 0.8945    |
| 0.0009        | 325.0 | 2600 | 0.0610          | 0.4133   | 0.8266        | 0.8266           | nan                | 0.8266         | 0.0           | 0.8266    |
| 0.0065        | 327.5 | 2620 | 0.0673          | 0.4195   | 0.8389        | 0.8389           | nan                | 0.8389         | 0.0           | 0.8389    |
| 0.003         | 330.0 | 2640 | 0.0626          | 0.3853   | 0.7706        | 0.7706           | nan                | 0.7706         | 0.0           | 0.7706    |
| 0.0048        | 332.5 | 2660 | 0.0849          | 0.4614   | 0.9229        | 0.9229           | nan                | 0.9229         | 0.0           | 0.9229    |
| 0.0041        | 335.0 | 2680 | 0.0235          | 0.3797   | 0.7594        | 0.7594           | nan                | 0.7594         | 0.0           | 0.7594    |
| 0.0014        | 337.5 | 2700 | 0.0863          | 0.4367   | 0.8734        | 0.8734           | nan                | 0.8734         | 0.0           | 0.8734    |
| 0.0058        | 340.0 | 2720 | 0.0570          | 0.4419   | 0.8839        | 0.8839           | nan                | 0.8839         | 0.0           | 0.8839    |
| 0.0051        | 342.5 | 2740 | 0.0551          | 0.4066   | 0.8132        | 0.8132           | nan                | 0.8132         | 0.0           | 0.8132    |
| 0.0061        | 345.0 | 2760 | 0.1018          | 0.4437   | 0.8874        | 0.8874           | nan                | 0.8874         | 0.0           | 0.8874    |
| 0.0037        | 347.5 | 2780 | 0.0993          | 0.4395   | 0.8791        | 0.8791           | nan                | 0.8791         | 0.0           | 0.8791    |
| 0.0021        | 350.0 | 2800 | 0.0393          | 0.3939   | 0.7878        | 0.7878           | nan                | 0.7878         | 0.0           | 0.7878    |
| 0.0068        | 352.5 | 2820 | 0.0244          | 0.3703   | 0.7406        | 0.7406           | nan                | 0.7406         | 0.0           | 0.7406    |
| 0.0033        | 355.0 | 2840 | 0.1167          | 0.4802   | 0.9604        | 0.9604           | nan                | 0.9604         | 0.0           | 0.9604    |
| 0.0024        | 357.5 | 2860 | 0.0592          | 0.4510   | 0.9019        | 0.9019           | nan                | 0.9019         | 0.0           | 0.9019    |
| 0.0037        | 360.0 | 2880 | 0.0345          | 0.4301   | 0.8603        | 0.8603           | nan                | 0.8603         | 0.0           | 0.8603    |
| 0.0026        | 362.5 | 2900 | 0.0461          | 0.3819   | 0.7639        | 0.7639           | nan                | 0.7639         | 0.0           | 0.7639    |
| 0.0021        | 365.0 | 2920 | 0.0749          | 0.4493   | 0.8986        | 0.8986           | nan                | 0.8986         | 0.0           | 0.8986    |
| 0.0011        | 367.5 | 2940 | 0.0410          | 0.4117   | 0.8235        | 0.8235           | nan                | 0.8235         | 0.0           | 0.8235    |
| 0.0066        | 370.0 | 2960 | 0.0345          | 0.3802   | 0.7604        | 0.7604           | nan                | 0.7604         | 0.0           | 0.7604    |
| 0.0021        | 372.5 | 2980 | 0.0317          | 0.3858   | 0.7715        | 0.7715           | nan                | 0.7715         | 0.0           | 0.7715    |
| 0.0024        | 375.0 | 3000 | 0.0411          | 0.3935   | 0.7871        | 0.7871           | nan                | 0.7871         | 0.0           | 0.7871    |
| 0.0041        | 377.5 | 3020 | 0.0520          | 0.3668   | 0.7336        | 0.7336           | nan                | 0.7336         | 0.0           | 0.7336    |
| 0.0054        | 380.0 | 3040 | 0.0696          | 0.4331   | 0.8662        | 0.8662           | nan                | 0.8662         | 0.0           | 0.8662    |
| 0.0025        | 382.5 | 3060 | 0.0733          | 0.4488   | 0.8977        | 0.8977           | nan                | 0.8977         | 0.0           | 0.8977    |
| 0.003         | 385.0 | 3080 | 0.0227          | 0.3969   | 0.7938        | 0.7938           | nan                | 0.7938         | 0.0           | 0.7938    |
| 0.0027        | 387.5 | 3100 | 0.0404          | 0.4348   | 0.8696        | 0.8696           | nan                | 0.8696         | 0.0           | 0.8696    |
| 0.0024        | 390.0 | 3120 | 0.0305          | 0.3848   | 0.7696        | 0.7696           | nan                | 0.7696         | 0.0           | 0.7696    |
| 0.0028        | 392.5 | 3140 | 0.0808          | 0.4544   | 0.9087        | 0.9087           | nan                | 0.9087         | 0.0           | 0.9087    |
| 0.0034        | 395.0 | 3160 | 0.0424          | 0.3964   | 0.7928        | 0.7928           | nan                | 0.7928         | 0.0           | 0.7928    |
| 0.002         | 397.5 | 3180 | 0.0513          | 0.4040   | 0.8080        | 0.8080           | nan                | 0.8080         | 0.0           | 0.8080    |
| 0.0048        | 400.0 | 3200 | 0.0534          | 0.4107   | 0.8214        | 0.8214           | nan                | 0.8214         | 0.0           | 0.8214    |
| 0.0028        | 402.5 | 3220 | 0.0439          | 0.4208   | 0.8416        | 0.8416           | nan                | 0.8416         | 0.0           | 0.8416    |
| 0.0027        | 405.0 | 3240 | 0.0818          | 0.4603   | 0.9207        | 0.9207           | nan                | 0.9207         | 0.0           | 0.9207    |
| 0.0012        | 407.5 | 3260 | 0.0618          | 0.4365   | 0.8730        | 0.8730           | nan                | 0.8730         | 0.0           | 0.8730    |
| 0.0006        | 410.0 | 3280 | 0.0907          | 0.4469   | 0.8939        | 0.8939           | nan                | 0.8939         | 0.0           | 0.8939    |
| 0.0023        | 412.5 | 3300 | 0.0850          | 0.4304   | 0.8609        | 0.8609           | nan                | 0.8609         | 0.0           | 0.8609    |
| 0.0063        | 415.0 | 3320 | 0.0759          | 0.4201   | 0.8402        | 0.8402           | nan                | 0.8402         | 0.0           | 0.8402    |
| 0.0013        | 417.5 | 3340 | 0.0740          | 0.4434   | 0.8867        | 0.8867           | nan                | 0.8867         | 0.0           | 0.8867    |
| 0.0057        | 420.0 | 3360 | 0.0611          | 0.4098   | 0.8196        | 0.8196           | nan                | 0.8196         | 0.0           | 0.8196    |
| 0.0025        | 422.5 | 3380 | 0.0554          | 0.4246   | 0.8491        | 0.8491           | nan                | 0.8491         | 0.0           | 0.8491    |
| 0.0009        | 425.0 | 3400 | 0.0778          | 0.4282   | 0.8563        | 0.8563           | nan                | 0.8563         | 0.0           | 0.8563    |
| 0.0028        | 427.5 | 3420 | 0.0680          | 0.4317   | 0.8635        | 0.8635           | nan                | 0.8635         | 0.0           | 0.8635    |
| 0.0023        | 430.0 | 3440 | 0.0654          | 0.4394   | 0.8788        | 0.8788           | nan                | 0.8788         | 0.0           | 0.8788    |
| 0.0025        | 432.5 | 3460 | 0.0788          | 0.4640   | 0.9279        | 0.9279           | nan                | 0.9279         | 0.0           | 0.9279    |
| 0.0022        | 435.0 | 3480 | 0.0643          | 0.4517   | 0.9035        | 0.9035           | nan                | 0.9035         | 0.0           | 0.9035    |
| 0.0045        | 437.5 | 3500 | 0.0637          | 0.4307   | 0.8613        | 0.8613           | nan                | 0.8613         | 0.0           | 0.8613    |
| 0.0035        | 440.0 | 3520 | 0.0549          | 0.4093   | 0.8186        | 0.8186           | nan                | 0.8186         | 0.0           | 0.8186    |
| 0.0034        | 442.5 | 3540 | 0.1051          | 0.4698   | 0.9396        | 0.9396           | nan                | 0.9396         | 0.0           | 0.9396    |
| 0.0021        | 445.0 | 3560 | 0.0800          | 0.4529   | 0.9058        | 0.9058           | nan                | 0.9058         | 0.0           | 0.9058    |
| 0.002         | 447.5 | 3580 | 0.1074          | 0.4614   | 0.9227        | 0.9227           | nan                | 0.9227         | 0.0           | 0.9227    |
| 0.0058        | 450.0 | 3600 | 0.0889          | 0.4463   | 0.8927        | 0.8927           | nan                | 0.8927         | 0.0           | 0.8927    |
| 0.0025        | 452.5 | 3620 | 0.0575          | 0.4435   | 0.8869        | 0.8869           | nan                | 0.8869         | 0.0           | 0.8869    |
| 0.0041        | 455.0 | 3640 | 0.0882          | 0.4613   | 0.9227        | 0.9227           | nan                | 0.9227         | 0.0           | 0.9227    |
| 0.0036        | 457.5 | 3660 | 0.0688          | 0.4206   | 0.8411        | 0.8411           | nan                | 0.8411         | 0.0           | 0.8411    |
| 0.0036        | 460.0 | 3680 | 0.0881          | 0.4253   | 0.8506        | 0.8506           | nan                | 0.8506         | 0.0           | 0.8506    |
| 0.0024        | 462.5 | 3700 | 0.0385          | 0.3948   | 0.7897        | 0.7897           | nan                | 0.7897         | 0.0           | 0.7897    |
| 0.0023        | 465.0 | 3720 | 0.1067          | 0.4589   | 0.9177        | 0.9177           | nan                | 0.9177         | 0.0           | 0.9177    |
| 0.002         | 467.5 | 3740 | 0.0687          | 0.4399   | 0.8798        | 0.8798           | nan                | 0.8798         | 0.0           | 0.8798    |
| 0.0051        | 470.0 | 3760 | 0.0754          | 0.4152   | 0.8303        | 0.8303           | nan                | 0.8303         | 0.0           | 0.8303    |
| 0.0045        | 472.5 | 3780 | 0.0821          | 0.4523   | 0.9045        | 0.9045           | nan                | 0.9045         | 0.0           | 0.9045    |
| 0.0006        | 475.0 | 3800 | 0.0443          | 0.3783   | 0.7565        | 0.7565           | nan                | 0.7565         | 0.0           | 0.7565    |
| 0.0028        | 477.5 | 3820 | 0.0482          | 0.4239   | 0.8478        | 0.8478           | nan                | 0.8478         | 0.0           | 0.8478    |
| 0.0059        | 480.0 | 3840 | 0.0990          | 0.4447   | 0.8894        | 0.8894           | nan                | 0.8894         | 0.0           | 0.8894    |
| 0.0028        | 482.5 | 3860 | 0.0677          | 0.4387   | 0.8774        | 0.8774           | nan                | 0.8774         | 0.0           | 0.8774    |
| 0.0052        | 485.0 | 3880 | 0.0469          | 0.4081   | 0.8163        | 0.8163           | nan                | 0.8163         | 0.0           | 0.8163    |
| 0.0041        | 487.5 | 3900 | 0.0569          | 0.4397   | 0.8795        | 0.8795           | nan                | 0.8795         | 0.0           | 0.8795    |
| 0.0039        | 490.0 | 3920 | 0.0341          | 0.3641   | 0.7283        | 0.7283           | nan                | 0.7283         | 0.0           | 0.7283    |
| 0.0028        | 492.5 | 3940 | 0.0388          | 0.4405   | 0.8809        | 0.8809           | nan                | 0.8809         | 0.0           | 0.8809    |
| 0.0038        | 495.0 | 3960 | 0.0623          | 0.3886   | 0.7772        | 0.7772           | nan                | 0.7772         | 0.0           | 0.7772    |
| 0.0026        | 497.5 | 3980 | 0.0923          | 0.4500   | 0.8999        | 0.8999           | nan                | 0.8999         | 0.0           | 0.8999    |
| 0.0023        | 500.0 | 4000 | 0.0550          | 0.4255   | 0.8510        | 0.8510           | nan                | 0.8510         | 0.0           | 0.8510    |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.17.1
- Tokenizers 0.15.2
