transformers tensorboard safetensors segformer vision image-segmentation generated_from_trainer base_model:nvidia/segformer-b5-finetuned-cityscapes-1024-1024 license:other endpoints_compatible region:us
---
license: other
base_model: nvidia/segformer-b5-finetuned-cityscapes-1024-1024
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b5-cityscapes-finetuned-coastTrain
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b5-cityscapes-finetuned-coastTrain

This model is a fine-tuned version of [nvidia/segformer-b5-finetuned-cityscapes-1024-1024](https://huggingface.co/nvidia/segformer-b5-finetuned-cityscapes-1024-1024) on the peldrak/coastTrain dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1881
- Mean Iou: 0.8269
- Mean Accuracy: 0.9060
- Overall Accuracy: 0.9424
- Accuracy Water: 0.9707
- Accuracy Whitewater: 0.7995
- Accuracy Sediment: 0.8682
- Accuracy Other Natural Terrain: 0.8548
- Accuracy Vegetation: 0.9256
- Accuracy Development: 0.9477
- Accuracy Unknown: 0.9753
- Iou Water: 0.9366
- Iou Whitewater: 0.6328
- Iou Sediment: 0.8126
- Iou Other Natural Terrain: 0.7202
- Iou Vegetation: 0.8474
- Iou Development: 0.8731
- Iou Unknown: 0.9654
- F1 Score: 0.9423

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Water | Accuracy Whitewater | Accuracy Sediment | Accuracy Other Natural Terrain | Accuracy Vegetation | Accuracy Development | Accuracy Unknown | Iou Water | Iou Whitewater | Iou Sediment | Iou Other Natural Terrain | Iou Vegetation | Iou Development | Iou Unknown | F1 Score |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------------:|:-------------------:|:-----------------:|:------------------------------:|:-------------------:|:--------------------:|:----------------:|:---------:|:--------------:|:------------:|:-------------------------:|:--------------:|:---------------:|:-----------:|:--------:|
| 1.5137        | 0.16  | 20   | 1.4093          | 0.2798   | 0.3909        | 0.5891           | 0.7019         | 0.0298              | 0.0296            | 0.0247                         | 0.9567              | 0.4761               | 0.5177           | 0.5641    | 0.0196         | 0.0292       | 0.0213                    | 0.3809         | 0.4281          | 0.5158      | 0.5595   |
| 1.055         | 0.31  | 40   | 1.0631          | 0.3577   | 0.4550        | 0.7052           | 0.8814         | 0.0052              | 0.2973            | 0.0004                         | 0.9572              | 0.4259               | 0.6178           | 0.7052    | 0.0050         | 0.2796       | 0.0004                    | 0.4917         | 0.4043          | 0.6175      | 0.6828   |
| 1.0713        | 0.47  | 60   | 0.8083          | 0.4894   | 0.5712        | 0.8248           | 0.9457         | 0.0002              | 0.6146            | 0.0                            | 0.8897              | 0.6666               | 0.8818           | 0.8231    | 0.0002         | 0.4732       | 0.0                       | 0.6786         | 0.5733          | 0.8773      | 0.8106   |
| 1.1381        | 0.62  | 80   | 0.7066          | 0.4937   | 0.5901        | 0.8202           | 0.8788         | 0.0                 | 0.5956            | 0.0051                         | 0.9164              | 0.8435               | 0.8913           | 0.8319    | 0.0            | 0.4887       | 0.0051                    | 0.6175         | 0.6277          | 0.8850      | 0.8107   |
| 1.7365        | 0.78  | 100  | 0.6244          | 0.5151   | 0.6193        | 0.8271           | 0.8129         | 0.0                 | 0.8459            | 0.0000                         | 0.8727              | 0.9082               | 0.8954           | 0.7790    | 0.0            | 0.5186       | 0.0000                    | 0.7262         | 0.6899          | 0.8922      | 0.8218   |
| 0.7307        | 0.93  | 120  | 0.5070          | 0.5352   | 0.6115        | 0.8598           | 0.9605         | 0.0                 | 0.6408            | 0.0                            | 0.9080              | 0.8753               | 0.8955           | 0.8718    | 0.0            | 0.5549       | 0.0                       | 0.6907         | 0.7387          | 0.8904      | 0.8458   |
| 1.1675        | 1.09  | 140  | 0.5019          | 0.5353   | 0.6205        | 0.8593           | 0.9221         | 0.0                 | 0.6875            | 0.0000                         | 0.9250              | 0.8983               | 0.9108           | 0.8673    | 0.0            | 0.5808       | 0.0000                    | 0.7074         | 0.7402          | 0.8514      | 0.8465   |
| 0.701         | 1.24  | 160  | 0.4414          | 0.5432   | 0.6326        | 0.8671           | 0.9344         | 0.0007              | 0.7689            | 0.0004                         | 0.8593              | 0.9636               | 0.9009           | 0.8799    | 0.0007         | 0.6322       | 0.0004                    | 0.7217         | 0.6796          | 0.8876      | 0.8559   |
| 0.7284        | 1.4   | 180  | 0.4495          | 0.5437   | 0.6268        | 0.8576           | 0.8939         | 0.0                 | 0.7874            | 0.0233                         | 0.9336              | 0.8510               | 0.8985           | 0.8509    | 0.0            | 0.5802       | 0.0233                    | 0.7158         | 0.7453          | 0.8902      | 0.8485   |
| 0.4898        | 1.55  | 200  | 0.3884          | 0.5559   | 0.6380        | 0.8772           | 0.9541         | 0.0                 | 0.7934            | 0.0144                         | 0.8666              | 0.9343               | 0.9031           | 0.8912    | 0.0            | 0.6746       | 0.0144                    | 0.7378         | 0.6831          | 0.8901      | 0.8656   |
| 0.3669        | 1.71  | 220  | 0.3874          | 0.5574   | 0.6333        | 0.8752           | 0.9796         | 0.0001              | 0.7557            | 0.0380                         | 0.8465              | 0.9239               | 0.8892           | 0.8747    | 0.0001         | 0.6674       | 0.0380                    | 0.7369         | 0.7045          | 0.8802      | 0.8625   |
| 0.6277        | 1.86  | 240  | 0.3964          | 0.5600   | 0.6406        | 0.8770           | 0.9221         | 0.0029              | 0.8164            | 0.0                            | 0.9202              | 0.9157               | 0.9069           | 0.8787    | 0.0029         | 0.6458       | 0.0                       | 0.7487         | 0.7474          | 0.8965      | 0.8657   |
| 0.3567        | 2.02  | 260  | 0.3927          | 0.5648   | 0.6499        | 0.8825           | 0.9215         | 0.0000              | 0.8792            | 0.0016                         | 0.8867              | 0.9531               | 0.9073           | 0.8862    | 0.0000         | 0.6898       | 0.0016                    | 0.7659         | 0.7127          | 0.8974      | 0.8717   |
| 0.4065        | 2.17  | 280  | 0.3756          | 0.5633   | 0.6377        | 0.8810           | 0.9551         | 0.0145              | 0.7178            | 0.0058                         | 0.9349              | 0.9232               | 0.9125           | 0.9051    | 0.0145         | 0.6369       | 0.0058                    | 0.7220         | 0.7586          | 0.9000      | 0.8686   |
| 0.7596        | 2.33  | 300  | 0.3224          | 0.5907   | 0.6599        | 0.9000           | 0.9569         | 0.0001              | 0.8956            | 0.0230                         | 0.9042              | 0.9352               | 0.9044           | 0.9019    | 0.0001         | 0.7377       | 0.0230                    | 0.7935         | 0.7806          | 0.8977      | 0.8879   |
| 0.3008        | 2.48  | 320  | 0.3164          | 0.6114   | 0.6773        | 0.9011           | 0.9518         | 0.0022              | 0.8608            | 0.1780                         | 0.9504              | 0.8886               | 0.9089           | 0.8993    | 0.0022         | 0.7541       | 0.1777                    | 0.7957         | 0.7517          | 0.8992      | 0.8919   |
| 0.346         | 2.64  | 340  | 0.2927          | 0.6143   | 0.6807        | 0.9064           | 0.9643         | 0.0198              | 0.8652            | 0.1390                         | 0.9219              | 0.9389               | 0.9156           | 0.9072    | 0.0197         | 0.7542       | 0.1388                    | 0.8234         | 0.7570          | 0.8999      | 0.8967   |
| 0.272         | 2.79  | 360  | 0.2769          | 0.6170   | 0.6786        | 0.9098           | 0.9711         | 0.0228              | 0.8956            | 0.1033                         | 0.9136              | 0.9310               | 0.9130           | 0.9071    | 0.0226         | 0.7745       | 0.1033                    | 0.8178         | 0.7908          | 0.9030      | 0.8992   |
| 1.1467        | 2.95  | 380  | 0.2737          | 0.6153   | 0.6746        | 0.9107           | 0.9669         | 0.0005              | 0.9234            | 0.0834                         | 0.9132              | 0.9179               | 0.9170           | 0.9041    | 0.0005         | 0.7624       | 0.0834                    | 0.8207         | 0.8251          | 0.9110      | 0.8995   |
| 0.2723        | 3.1   | 400  | 0.3110          | 0.6254   | 0.6931        | 0.8984           | 0.9796         | 0.0115              | 0.8782            | 0.2913                         | 0.8216              | 0.9572               | 0.9124           | 0.8902    | 0.0115         | 0.7610       | 0.2882                    | 0.7610         | 0.7626          | 0.9032      | 0.8900   |
| 0.5568        | 3.26  | 420  | 0.3337          | 0.6544   | 0.7155        | 0.9012           | 0.9500         | 0.0359              | 0.7990            | 0.4369                         | 0.9408              | 0.9111               | 0.9345           | 0.8904    | 0.0356         | 0.7152       | 0.4322                    | 0.7726         | 0.8280          | 0.9068      | 0.8948   |
| 1.1779        | 3.41  | 440  | 0.2947          | 0.6237   | 0.6857        | 0.9057           | 0.9679         | 0.0133              | 0.7896            | 0.2042                         | 0.9229              | 0.9476               | 0.9541           | 0.9116    | 0.0133         | 0.7095       | 0.2041                    | 0.7783         | 0.8135          | 0.9357      | 0.8961   |
| 0.4611        | 3.57  | 460  | 0.2659          | 0.6563   | 0.7149        | 0.9153           | 0.9562         | 0.0761              | 0.9265            | 0.2765                         | 0.9315              | 0.9160               | 0.9215           | 0.9051    | 0.0754         | 0.7745       | 0.2759                    | 0.8331         | 0.8170          | 0.9133      | 0.9084   |
| 0.3981        | 3.72  | 480  | 0.2964          | 0.6657   | 0.7269        | 0.9046           | 0.9789         | 0.0658              | 0.8862            | 0.4978                         | 0.8601              | 0.8802               | 0.9193           | 0.8972    | 0.0648         | 0.7316       | 0.4900                    | 0.7955         | 0.7687          | 0.9118      | 0.8991   |
| 0.2398        | 3.88  | 500  | 0.2707          | 0.7112   | 0.7714        | 0.9181           | 0.9553         | 0.2649              | 0.8826            | 0.5232                         | 0.9516              | 0.8983               | 0.9236           | 0.9130    | 0.2463         | 0.7796       | 0.5159                    | 0.8301         | 0.7813          | 0.9125      | 0.9154   |
| 0.251         | 4.03  | 520  | 0.2693          | 0.6980   | 0.7686        | 0.9135           | 0.9680         | 0.2384              | 0.8886            | 0.5380                         | 0.8746              | 0.9509               | 0.9215           | 0.9247    | 0.2301         | 0.7644       | 0.5082                    | 0.8135         | 0.7432          | 0.9019      | 0.9110   |
| 0.4024        | 4.19  | 540  | 0.2900          | 0.6988   | 0.7641        | 0.9099           | 0.9662         | 0.2524              | 0.8416            | 0.5462                         | 0.8835              | 0.8924               | 0.9662           | 0.9022    | 0.2351         | 0.7297       | 0.4979                    | 0.7912         | 0.8078          | 0.9278      | 0.9065   |
| 0.3683        | 4.34  | 560  | 0.2852          | 0.7226   | 0.7853        | 0.9153           | 0.9567         | 0.3140              | 0.8381            | 0.5886                         | 0.9349              | 0.9398               | 0.9248           | 0.9165    | 0.2981         | 0.7355       | 0.5773                    | 0.8091         | 0.8062          | 0.9154      | 0.9132   |
| 0.2335        | 4.5   | 580  | 0.3128          | 0.7163   | 0.7833        | 0.9052           | 0.9370         | 0.3077              | 0.8492            | 0.6411                         | 0.9398              | 0.8903               | 0.9182           | 0.8904    | 0.2859         | 0.6985       | 0.6154                    | 0.8052         | 0.8088          | 0.9103      | 0.9038   |
| 1.5312        | 4.65  | 600  | 0.2551          | 0.7199   | 0.7784        | 0.9199           | 0.9599         | 0.3232              | 0.8606            | 0.4929                         | 0.9314              | 0.9399               | 0.9410           | 0.9213    | 0.3082         | 0.7482       | 0.4884                    | 0.8132         | 0.8258          | 0.9342      | 0.9175   |
| 0.3685        | 4.81  | 620  | 0.2286          | 0.7447   | 0.8053        | 0.9245           | 0.9757         | 0.3914              | 0.8468            | 0.6323                         | 0.9213              | 0.9265               | 0.9431           | 0.9183    | 0.3353         | 0.7791       | 0.5920                    | 0.8197         | 0.8356          | 0.9329      | 0.9226   |
| 0.2664        | 4.96  | 640  | 0.3448          | 0.7422   | 0.8128        | 0.9120           | 0.9329         | 0.4951              | 0.8208            | 0.6164                         | 0.9396              | 0.9166               | 0.9679           | 0.9033    | 0.4493         | 0.7043       | 0.5822                    | 0.7999         | 0.8185          | 0.9377      | 0.9112   |
| 0.2662        | 5.12  | 660  | 0.2932          | 0.7448   | 0.8158        | 0.9168           | 0.9516         | 0.5045              | 0.8308            | 0.6171                         | 0.9215              | 0.9234               | 0.9616           | 0.9128    | 0.4277         | 0.7379       | 0.5809                    | 0.8022         | 0.8260          | 0.9261      | 0.9157   |
| 1.1342        | 5.27  | 680  | 0.2631          | 0.7772   | 0.8420        | 0.9267           | 0.9816         | 0.5460              | 0.7974            | 0.7644                         | 0.9196              | 0.9208               | 0.9640           | 0.9220    | 0.4753         | 0.7476       | 0.6784                    | 0.8126         | 0.8527          | 0.9521      | 0.9253   |
| 0.2968        | 5.43  | 700  | 0.2302          | 0.7884   | 0.8577        | 0.9318           | 0.9537         | 0.5790              | 0.8663            | 0.7551                         | 0.9368              | 0.9450               | 0.9680           | 0.9260    | 0.5104         | 0.7765       | 0.6694                    | 0.8353         | 0.8467          | 0.9547      | 0.9315   |
| 0.3812        | 5.58  | 720  | 0.2051          | 0.7779   | 0.8372        | 0.9336           | 0.9772         | 0.4866              | 0.8627            | 0.7113                         | 0.9184              | 0.9430               | 0.9612           | 0.9189    | 0.3999         | 0.8046       | 0.6717                    | 0.8473         | 0.8508          | 0.9517      | 0.9325   |
| 0.1902        | 5.74  | 740  | 0.2044          | 0.7815   | 0.8584        | 0.9330           | 0.9651         | 0.5500              | 0.8494            | 0.8160                         | 0.9469              | 0.9219               | 0.9597           | 0.9253    | 0.4528         | 0.7914       | 0.6608                    | 0.8459         | 0.8452          | 0.9490      | 0.9325   |
| 0.2853        | 5.89  | 760  | 0.2718          | 0.7844   | 0.8523        | 0.9239           | 0.9479         | 0.5953              | 0.8483            | 0.7417                         | 0.9288              | 0.9486               | 0.9554           | 0.9179    | 0.5321         | 0.7413       | 0.6981                    | 0.8124         | 0.8399          | 0.9495      | 0.9238   |
| 0.1833        | 6.05  | 780  | 0.2191          | 0.7903   | 0.8613        | 0.9288           | 0.9598         | 0.6288              | 0.8627            | 0.7658                         | 0.9246              | 0.9327               | 0.9546           | 0.9209    | 0.5326         | 0.7646       | 0.6852                    | 0.8253         | 0.8539          | 0.9494      | 0.9286   |
| 0.2128        | 6.2   | 800  | 0.1897          | 0.8066   | 0.8748        | 0.9392           | 0.9703         | 0.6067              | 0.9032            | 0.8183                         | 0.9098              | 0.9555               | 0.9599           | 0.9274    | 0.5356         | 0.8336       | 0.7080                    | 0.8593         | 0.8315          | 0.9506      | 0.9388   |
| 0.2327        | 6.36  | 820  | 0.2148          | 0.7999   | 0.8734        | 0.9341           | 0.9531         | 0.6428              | 0.9396            | 0.7743                         | 0.8991              | 0.9443               | 0.9604           | 0.9131    | 0.5264         | 0.8037       | 0.6901                    | 0.8537         | 0.8609          | 0.9518      | 0.9342   |
| 1.0808        | 6.51  | 840  | 0.2443          | 0.7872   | 0.8597        | 0.9273           | 0.9631         | 0.6632              | 0.8257            | 0.7386                         | 0.9302              | 0.9392               | 0.9580           | 0.9267    | 0.5440         | 0.7644       | 0.6807                    | 0.8081         | 0.8341          | 0.9524      | 0.9270   |
| 0.2563        | 6.67  | 860  | 0.2376          | 0.7825   | 0.8473        | 0.9288           | 0.9637         | 0.5780              | 0.8420            | 0.7267                         | 0.9379              | 0.9213               | 0.9619           | 0.9198    | 0.4945         | 0.7607       | 0.6624                    | 0.8265         | 0.8596          | 0.9542      | 0.9282   |
| 0.209         | 6.82  | 880  | 0.2008          | 0.7996   | 0.8652        | 0.9353           | 0.9713         | 0.5989              | 0.8857            | 0.7859                         | 0.9103              | 0.9475               | 0.9567           | 0.9236    | 0.5153         | 0.8064       | 0.7099                    | 0.8452         | 0.8452          | 0.9516      | 0.9349   |
| 0.1402        | 6.98  | 900  | 0.2454          | 0.7832   | 0.8475        | 0.9295           | 0.9673         | 0.6082              | 0.8135            | 0.7021                         | 0.9518              | 0.9292               | 0.9603           | 0.9271    | 0.5157         | 0.7680       | 0.6419                    | 0.8117         | 0.8636          | 0.9544      | 0.9289   |
| 0.383         | 7.13  | 920  | 0.2064          | 0.7999   | 0.8706        | 0.9334           | 0.9720         | 0.6260              | 0.8447            | 0.8266                         | 0.9219              | 0.9434               | 0.9599           | 0.9269    | 0.5389         | 0.7808       | 0.7077                    | 0.8303         | 0.8620          | 0.9528      | 0.9329   |
| 0.5665        | 7.29  | 940  | 0.2529          | 0.7892   | 0.8836        | 0.9279           | 0.9513         | 0.7850              | 0.8478            | 0.7735                         | 0.9296              | 0.9380               | 0.9601           | 0.9205    | 0.5403         | 0.7625       | 0.6755                    | 0.8270         | 0.8449          | 0.9539      | 0.9284   |
| 0.2031        | 7.44  | 960  | 0.2445          | 0.7782   | 0.8562        | 0.9276           | 0.9491         | 0.6769              | 0.8635            | 0.6824                         | 0.9435              | 0.9101               | 0.9680           | 0.9197    | 0.5111         | 0.7486       | 0.6226                    | 0.8341         | 0.8524          | 0.9592      | 0.9277   |
| 0.1641        | 7.6   | 980  | 0.1669          | 0.8201   | 0.8875        | 0.9475           | 0.9762         | 0.6290              | 0.9007            | 0.8526                         | 0.9303              | 0.9519               | 0.9719           | 0.9374    | 0.5367         | 0.8539       | 0.7152                    | 0.8790         | 0.8560          | 0.9624      | 0.9472   |
| 0.1214        | 7.75  | 1000 | 0.1696          | 0.8279   | 0.8914        | 0.9479           | 0.9685         | 0.7061              | 0.9217            | 0.7959                         | 0.9472              | 0.9376               | 0.9630           | 0.9371    | 0.5860         | 0.8561       | 0.7139                    | 0.8779         | 0.8673          | 0.9570      | 0.9478   |
| 0.0926        | 7.91  | 1020 | 0.2069          | 0.8005   | 0.8677        | 0.9339           | 0.9733         | 0.6746              | 0.8183            | 0.7692                         | 0.9485              | 0.9307               | 0.9595           | 0.9405    | 0.5605         | 0.7717       | 0.7126                    | 0.8248         | 0.8397          | 0.9540      | 0.9334   |
| 0.4292        | 8.06  | 1040 | 0.1985          | 0.8140   | 0.8845        | 0.9408           | 0.9620         | 0.6695              | 0.9283            | 0.8152                         | 0.9259              | 0.9310               | 0.9596           | 0.9263    | 0.5722         | 0.8215       | 0.6976                    | 0.8728         | 0.8538          | 0.9535      | 0.9409   |
| 0.1741        | 8.22  | 1060 | 0.2038          | 0.8082   | 0.8877        | 0.9352           | 0.9619         | 0.7341              | 0.8483            | 0.8190                         | 0.9322              | 0.9496               | 0.9685           | 0.9296    | 0.5834         | 0.7820       | 0.7134                    | 0.8411         | 0.8503          | 0.9579      | 0.9351   |
| 0.218         | 8.37  | 1080 | 0.1888          | 0.8054   | 0.8766        | 0.9409           | 0.9770         | 0.7073              | 0.8644            | 0.7571                         | 0.9442              | 0.9211               | 0.9653           | 0.9381    | 0.5579         | 0.8125       | 0.6568                    | 0.8547         | 0.8599          | 0.9581      | 0.9406   |
| 0.1687        | 8.53  | 1100 | 0.1887          | 0.8208   | 0.8996        | 0.9424           | 0.9617         | 0.7261              | 0.9048            | 0.8567                         | 0.9210              | 0.9514               | 0.9754           | 0.9320    | 0.6109         | 0.8214       | 0.6963                    | 0.8650         | 0.8558          | 0.9643      | 0.9425   |
| 0.1115        | 8.68  | 1120 | 0.1924          | 0.8137   | 0.8967        | 0.9390           | 0.9737         | 0.7728              | 0.8477            | 0.8500                         | 0.9296              | 0.9305               | 0.9726           | 0.9374    | 0.6039         | 0.7985       | 0.6894                    | 0.8367         | 0.8657          | 0.9640      | 0.9389   |
| 0.2189        | 8.84  | 1140 | 0.1950          | 0.8102   | 0.8791        | 0.9397           | 0.9718         | 0.6680              | 0.8758            | 0.8029                         | 0.9293              | 0.9407               | 0.9655           | 0.9321    | 0.5657         | 0.8183       | 0.6952                    | 0.8497         | 0.8525          | 0.9581      | 0.9395   |
| 0.2046        | 8.99  | 1160 | 0.1955          | 0.8183   | 0.8889        | 0.9409           | 0.9707         | 0.7188              | 0.8764            | 0.8236                         | 0.9345              | 0.9287               | 0.9693           | 0.9349    | 0.5922         | 0.8067       | 0.7146                    | 0.8500         | 0.8690          | 0.9610      | 0.9407   |
| 0.0574        | 9.15  | 1180 | 0.1943          | 0.8258   | 0.9017        | 0.9423           | 0.9642         | 0.7756              | 0.8757            | 0.8409                         | 0.9354              | 0.9389               | 0.9813           | 0.9362    | 0.6173         | 0.8057       | 0.7304                    | 0.8544         | 0.8714          | 0.9653      | 0.9423   |
| 0.1683        | 9.3   | 1200 | 0.1685          | 0.8342   | 0.8967        | 0.9487           | 0.9695         | 0.7096              | 0.9281            | 0.8261                         | 0.9382              | 0.9376               | 0.9676           | 0.9368    | 0.6100         | 0.8515       | 0.7291                    | 0.8807         | 0.8726          | 0.9590      | 0.9486   |
| 0.1265        | 9.46  | 1220 | 0.1684          | 0.8278   | 0.8829        | 0.9482           | 0.9764         | 0.6761              | 0.9042            | 0.7785                         | 0.9515              | 0.9278               | 0.9657           | 0.9404    | 0.5943         | 0.8480       | 0.7065                    | 0.8732         | 0.8729          | 0.9595      | 0.9479   |
| 0.1052        | 9.61  | 1240 | 0.1743          | 0.8176   | 0.8969        | 0.9441           | 0.9750         | 0.7880              | 0.8907            | 0.7930                         | 0.9261              | 0.9333               | 0.9721           | 0.9343    | 0.5809         | 0.8331       | 0.6799                    | 0.8665         | 0.8654          | 0.9634      | 0.9441   |
| 0.1972        | 9.77  | 1260 | 0.2006          | 0.8135   | 0.8781        | 0.9385           | 0.9731         | 0.6571              | 0.8506            | 0.8227                         | 0.9316              | 0.9379               | 0.9735           | 0.9315    | 0.5703         | 0.7969       | 0.7257                    | 0.8386         | 0.8669          | 0.9643      | 0.9380   |
| 0.2727        | 9.92  | 1280 | 0.1952          | 0.8091   | 0.8666        | 0.9412           | 0.9714         | 0.6697              | 0.8829            | 0.7132                         | 0.9561              | 0.9058               | 0.9672           | 0.9344    | 0.5762         | 0.8125       | 0.6553                    | 0.8544         | 0.8714          | 0.9594      | 0.9407   |
| 0.1478        | 10.08 | 1300 | 0.1935          | 0.8153   | 0.8976        | 0.9395           | 0.9675         | 0.7368              | 0.8569            | 0.8718                         | 0.9352              | 0.9506               | 0.9644           | 0.9317    | 0.6118         | 0.7976       | 0.6876                    | 0.8580         | 0.8621          | 0.9584      | 0.9395   |
| 0.2574        | 10.23 | 1320 | 0.2107          | 0.8154   | 0.8888        | 0.9384           | 0.9586         | 0.7452              | 0.8745            | 0.8039                         | 0.9545              | 0.9184               | 0.9668           | 0.9285    | 0.5996         | 0.7961       | 0.7035                    | 0.8515         | 0.8681          | 0.9603      | 0.9385   |
| 0.9414        | 10.39 | 1340 | 0.1919          | 0.8221   | 0.8939        | 0.9428           | 0.9653         | 0.7195              | 0.8869            | 0.8314                         | 0.9350              | 0.9456               | 0.9736           | 0.9319    | 0.5980         | 0.8148       | 0.7137                    | 0.8644         | 0.8668          | 0.9652      | 0.9427   |
| 0.1415        | 10.54 | 1360 | 0.2000          | 0.8247   | 0.8946        | 0.9417           | 0.9687         | 0.7613              | 0.8609            | 0.8152                         | 0.9407              | 0.9392               | 0.9761           | 0.9386    | 0.6259         | 0.8026       | 0.7224                    | 0.8437         | 0.8722          | 0.9673      | 0.9416   |
| 0.1511        | 10.7  | 1380 | 0.1881          | 0.8269   | 0.9060        | 0.9424           | 0.9707         | 0.7995              | 0.8682            | 0.8548                         | 0.9256              | 0.9477               | 0.9753           | 0.9366    | 0.6328         | 0.8126       | 0.7202                    | 0.8474         | 0.8731          | 0.9654      | 0.9423   |


### Framework versions

- Transformers 4.37.0
- Pytorch 2.1.2
- Datasets 2.18.0
- Tokenizers 0.15.1
