transformers pytorch tensorboard dinov2 multilabel-image-classification multilabel generated_from_trainer image-classification eng base_model:facebook/dinov2-large license:apache-2.0 endpoints_compatible region:us
---
language:
- eng
license: apache-2.0
base_model: facebook/dinov2-large
tags:
- multilabel-image-classification
- multilabel
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: dinov2-large-2024_01_05-kornia_img-size518_batch-size32_epochs70_freeze
  results: []
pipeline_tag: image-classification
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# dinov2-large-2024_01_05-kornia_img-size518_batch-size32_epochs70_freeze

This model is a fine-tuned version of [facebook/dinov2-large](https://huggingface.co/facebook/dinov2-large) on the multilabel_complete_dataset dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0825
- F1 Micro: 0.8570
- F1 Macro: 0.7430
- Roc Auc: 0.9080
- Accuracy: 0.5739
- Learning Rate: 0.0000

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.01
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 140

### Training results

| Training Loss | Epoch | Step  | Accuracy | F1 Macro | F1 Micro | Validation Loss | Roc Auc | Rate   |
|:-------------:|:-----:|:-----:|:--------:|:--------:|:--------:|:---------------:|:-------:|:------:|
| No log        | 1.0   | 274   | 0.4456   | 0.5756   | 0.7376   | 0.1358          | 0.8276  | 0.01   |
| 0.1895        | 2.0   | 548   | 0.4358   | 0.6131   | 0.7463   | 0.1422          | 0.8433  | 0.01   |
| 0.1895        | 3.0   | 822   | 0.3842   | 0.5242   | 0.7273   | 0.2134          | 0.8305  | 0.01   |
| 0.1668        | 4.0   | 1096  | 0.4438   | 0.5474   | 0.7034   | 0.1450          | 0.7947  | 0.01   |
| 0.1668        | 5.0   | 1370  | 0.4438   | 0.6195   | 0.7611   | 0.1329          | 0.8536  | 0.01   |
| 0.1666        | 6.0   | 1644  | 0.4445   | 0.5625   | 0.7528   | 0.1324          | 0.8411  | 0.01   |
| 0.1666        | 7.0   | 1918  | 0.4313   | 0.5690   | 0.7496   | 0.1345          | 0.8390  | 0.01   |
| 0.1664        | 8.0   | 2192  | 0.4323   | 0.5628   | 0.7502   | 0.1381          | 0.8397  | 0.01   |
| 0.1664        | 9.0   | 2466  | 0.4403   | 0.5492   | 0.7396   | 0.1369          | 0.8220  | 0.01   |
| 0.1656        | 10.0  | 2740  | 0.4424   | 0.5282   | 0.7327   | 0.1361          | 0.8212  | 0.01   |
| 0.166         | 11.0  | 3014  | 0.4278   | 0.5428   | 0.7434   | 0.1381          | 0.8371  | 0.01   |
| 0.166         | 12.0  | 3288  | 0.4449   | 0.5619   | 0.7355   | 0.1345          | 0.8279  | 0.01   |
| 0.1585        | 13.0  | 3562  | 0.4902   | 0.6501   | 0.8009   | 0.1155          | 0.8746  | 0.001  |
| 0.1585        | 14.0  | 3836  | 0.5042   | 0.6697   | 0.8079   | 0.1116          | 0.8751  | 0.001  |
| 0.133         | 15.0  | 4110  | 0.5181   | 0.6736   | 0.8149   | 0.1073          | 0.8772  | 0.001  |
| 0.133         | 16.0  | 4384  | 0.5084   | 0.7056   | 0.8238   | 0.1048          | 0.8975  | 0.001  |
| 0.1289        | 17.0  | 4658  | 0.5244   | 0.6896   | 0.8209   | 0.1025          | 0.8839  | 0.001  |
| 0.1289        | 18.0  | 4932  | 0.5321   | 0.7045   | 0.8290   | 0.1026          | 0.8916  | 0.001  |
| 0.1227        | 19.0  | 5206  | 0.5279   | 0.6905   | 0.8306   | 0.1012          | 0.8941  | 0.001  |
| 0.1227        | 20.0  | 5480  | 0.5216   | 0.6831   | 0.8280   | 0.0997          | 0.8930  | 0.001  |
| 0.1202        | 21.0  | 5754  | 0.5352   | 0.6927   | 0.8300   | 0.0989          | 0.8896  | 0.001  |
| 0.12          | 22.0  | 6028  | 0.5209   | 0.6961   | 0.8280   | 0.0996          | 0.8893  | 0.001  |
| 0.12          | 23.0  | 6302  | 0.5195   | 0.6959   | 0.8319   | 0.0972          | 0.8956  | 0.001  |
| 0.1179        | 24.0  | 6576  | 0.5213   | 0.6881   | 0.8271   | 0.1008          | 0.8916  | 0.001  |
| 0.1179        | 25.0  | 6850  | 0.5269   | 0.6860   | 0.8283   | 0.0983          | 0.8863  | 0.001  |
| 0.1166        | 26.0  | 7124  | 0.5311   | 0.6806   | 0.8284   | 0.0985          | 0.8876  | 0.001  |
| 0.1166        | 27.0  | 7398  | 0.5324   | 0.6901   | 0.8305   | 0.0957          | 0.8876  | 0.001  |
| 0.1158        | 28.0  | 7672  | 0.5178   | 0.7054   | 0.8292   | 0.0995          | 0.8935  | 0.001  |
| 0.1158        | 29.0  | 7946  | 0.5335   | 0.7026   | 0.8364   | 0.0933          | 0.8971  | 0.001  |
| 0.114         | 30.0  | 8220  | 0.5258   | 0.7110   | 0.8351   | 0.0947          | 0.9019  | 0.001  |
| 0.114         | 31.0  | 8494  | 0.5331   | 0.7175   | 0.8365   | 0.0967          | 0.9046  | 0.001  |
| 0.1134        | 32.0  | 8768  | 0.5324   | 0.6933   | 0.8354   | 0.0949          | 0.8948  | 0.001  |
| 0.113         | 33.0  | 9042  | 0.5363   | 0.6973   | 0.8367   | 0.0951          | 0.8967  | 0.001  |
| 0.113         | 34.0  | 9316  | 0.5380   | 0.6878   | 0.8335   | 0.0936          | 0.8876  | 0.001  |
| 0.1124        | 35.0  | 9590  | 0.5311   | 0.6856   | 0.8340   | 0.0936          | 0.8944  | 0.001  |
| 0.1124        | 36.0  | 9864  | 0.5454   | 0.7298   | 0.8456   | 0.0934          | 0.9031  | 0.0001 |
| 0.1083        | 37.0  | 10138 | 0.5468   | 0.7189   | 0.8457   | 0.0924          | 0.8999  | 0.0001 |
| 0.1083        | 38.0  | 10412 | 0.5450   | 0.7089   | 0.8449   | 0.0915          | 0.9004  | 0.0001 |
| 0.1034        | 39.0  | 10686 | 0.5485   | 0.7252   | 0.8488   | 0.0902          | 0.9078  | 0.0001 |
| 0.1034        | 40.0  | 10960 | 0.5495   | 0.7182   | 0.8459   | 0.0906          | 0.9011  | 0.0001 |
| 0.1024        | 41.0  | 11234 | 0.5506   | 0.7130   | 0.8481   | 0.0894          | 0.9020  | 0.0001 |
| 0.1004        | 42.0  | 11508 | 0.5520   | 0.7148   | 0.8457   | 0.0873          | 0.8977  | 0.0001 |
| 0.1004        | 43.0  | 11782 | 0.5537   | 0.7182   | 0.8495   | 0.0870          | 0.9062  | 0.0001 |
| 0.0998        | 44.0  | 12056 | 0.5499   | 0.7261   | 0.8486   | 0.0868          | 0.9033  | 0.0001 |
| 0.0998        | 45.0  | 12330 | 0.5551   | 0.7236   | 0.8493   | 0.0868          | 0.9053  | 0.0001 |
| 0.0975        | 46.0  | 12604 | 0.5513   | 0.7318   | 0.8490   | 0.0865          | 0.9072  | 0.0001 |
| 0.0975        | 47.0  | 12878 | 0.5548   | 0.7390   | 0.8512   | 0.0860          | 0.9088  | 0.0001 |
| 0.099         | 48.0  | 13152 | 0.5558   | 0.7360   | 0.8510   | 0.0860          | 0.9055  | 0.0001 |
| 0.099         | 49.0  | 13426 | 0.5548   | 0.7362   | 0.8500   | 0.0858          | 0.9058  | 0.0001 |
| 0.0972        | 50.0  | 13700 | 0.5586   | 0.7257   | 0.8505   | 0.0856          | 0.9033  | 0.0001 |
| 0.0972        | 51.0  | 13974 | 0.5579   | 0.7409   | 0.8500   | 0.0856          | 0.9038  | 0.0001 |
| 0.0957        | 52.0  | 14248 | 0.5569   | 0.7232   | 0.8508   | 0.0859          | 0.9035  | 0.0001 |
| 0.0964        | 53.0  | 14522 | 0.5628   | 0.7276   | 0.8521   | 0.0849          | 0.9058  | 0.0001 |
| 0.0964        | 54.0  | 14796 | 0.5537   | 0.7395   | 0.8539   | 0.0852          | 0.9116  | 0.0001 |
| 0.0955        | 55.0  | 15070 | 0.5565   | 0.7354   | 0.8511   | 0.0851          | 0.9041  | 0.0001 |
| 0.0955        | 56.0  | 15344 | 0.5572   | 0.7367   | 0.8529   | 0.0849          | 0.9067  | 0.0001 |
| 0.095         | 57.0  | 15618 | 0.5537   | 0.7242   | 0.8494   | 0.0848          | 0.8994  | 0.0001 |
| 0.095         | 58.0  | 15892 | 0.5593   | 0.7363   | 0.8512   | 0.0845          | 0.9029  | 0.0001 |
| 0.093         | 59.0  | 16166 | 0.5607   | 0.7390   | 0.8531   | 0.0840          | 0.9058  | 0.0001 |
| 0.093         | 60.0  | 16440 | 0.5562   | 0.7473   | 0.8528   | 0.0847          | 0.9116  | 0.0001 |
| 0.0936        | 61.0  | 16714 | 0.5523   | 0.7425   | 0.8517   | 0.0843          | 0.9078  | 0.0001 |
| 0.0936        | 62.0  | 16988 | 0.5541   | 0.7456   | 0.8515   | 0.0844          | 0.9053  | 0.0001 |
| 0.0932        | 63.0  | 17262 | 0.5576   | 0.7344   | 0.8535   | 0.0840          | 0.9062  | 0.0001 |
| 0.0933        | 64.0  | 17536 | 0.5614   | 0.7405   | 0.8543   | 0.0840          | 0.9072  | 0.0001 |
| 0.0933        | 65.0  | 17810 | 0.5579   | 0.7354   | 0.8507   | 0.0840          | 0.9016  | 0.0001 |
| 0.0921        | 66.0  | 18084 | 0.5569   | 0.7297   | 0.8529   | 0.0841          | 0.9066  | 0.0001 |
| 0.0921        | 67.0  | 18358 | 0.5541   | 0.7393   | 0.8540   | 0.0838          | 0.9100  | 0.0001 |
| 0.0913        | 68.0  | 18632 | 0.5572   | 0.7403   | 0.8541   | 0.0836          | 0.9090  | 0.0001 |
| 0.0913        | 69.0  | 18906 | 0.5583   | 0.7494   | 0.8548   | 0.0835          | 0.9100  | 0.0001 |
| 0.0911        | 70.0  | 19180 | 0.5562   | 0.7487   | 0.8552   | 0.0831          | 0.9104  | 0.0001 |
| 0.0911        | 71.0  | 19454 | 0.0835   | 0.8557   | 0.7484   | 0.9102          | 0.5579  | 0.0001 |
| 0.0907        | 72.0  | 19728 | 0.0832   | 0.8532   | 0.7446   | 0.9037          | 0.5611  | 0.0001 |
| 0.0905        | 73.0  | 20002 | 0.0827   | 0.8558   | 0.7512   | 0.9105          | 0.5576  | 0.0001 |
| 0.0905        | 74.0  | 20276 | 0.0835   | 0.8548   | 0.7519   | 0.9090          | 0.5590  | 0.0001 |
| 0.0896        | 75.0  | 20550 | 0.0829   | 0.8535   | 0.7428   | 0.9053          | 0.5565  | 0.0001 |
| 0.0896        | 76.0  | 20824 | 0.0828   | 0.8561   | 0.7449   | 0.9091          | 0.5642  | 0.0001 |
| 0.089         | 77.0  | 21098 | 0.0827   | 0.8568   | 0.7507   | 0.9102          | 0.5604  | 0.0001 |
| 0.089         | 78.0  | 21372 | 0.0833   | 0.8529   | 0.7436   | 0.9067          | 0.5579  | 0.0001 |
| 0.0892        | 79.0  | 21646 | 0.0830   | 0.8540   | 0.7502   | 0.9055          | 0.5590  | 0.0001 |
| 0.0892        | 80.0  | 21920 | 0.0827   | 0.8548   | 0.7461   | 0.9049          | 0.5600  | 1e-05  |
| 0.0879        | 81.0  | 22194 | 0.0823   | 0.8576   | 0.7543   | 0.9116          | 0.5607  | 1e-05  |
| 0.0879        | 82.0  | 22468 | 0.0822   | 0.8576   | 0.7536   | 0.9112          | 0.5632  | 1e-05  |
| 0.0867        | 83.0  | 22742 | 0.0822   | 0.8554   | 0.7520   | 0.9058          | 0.5625  | 1e-05  |
| 0.0864        | 84.0  | 23016 | 0.0821   | 0.8551   | 0.7511   | 0.9072          | 0.5639  | 1e-05  |
| 0.0864        | 85.0  | 23290 | 0.0820   | 0.8560   | 0.7533   | 0.9067          | 0.5618  | 1e-05  |
| 0.0865        | 86.0  | 23564 | 0.0821   | 0.8553   | 0.7496   | 0.9060          | 0.5600  | 1e-05  |
| 0.0865        | 87.0  | 23838 | 0.0817   | 0.8559   | 0.7519   | 0.9081          | 0.5586  | 1e-05  |
| 0.0868        | 88.0  | 24112 | 0.0817   | 0.8558   | 0.7526   | 0.9082          | 0.5621  | 1e-05  |
| 0.0868        | 89.0  | 24386 | 0.0818   | 0.8570   | 0.7536   | 0.9083          | 0.5639  | 1e-05  |
| 0.0857        | 90.0  | 24660 | 0.0818   | 0.8558   | 0.7522   | 0.9081          | 0.5618  | 1e-05  |
| 0.0857        | 91.0  | 24934 | 0.0818   | 0.8569   | 0.7496   | 0.9081          | 0.5632  | 1e-05  |
| 0.0862        | 92.0  | 25208 | 0.0821   | 0.8566   | 0.7552   | 0.9093          | 0.5649  | 1e-05  |
| 0.0862        | 93.0  | 25482 | 0.0815   | 0.8589   | 0.7580   | 0.9130          | 0.5628  | 1e-05  |
| 0.0851        | 94.0  | 25756 | 0.0816   | 0.8571   | 0.7566   | 0.9117          | 0.5600  | 1e-05  |
| 0.0854        | 95.0  | 26030 | 0.0815   | 0.8564   | 0.7553   | 0.9100          | 0.5632  | 1e-05  |
| 0.0854        | 96.0  | 26304 | 0.0815   | 0.8576   | 0.7585   | 0.9124          | 0.5621  | 1e-05  |
| 0.0854        | 97.0  | 26578 | 0.0817   | 0.8576   | 0.7579   | 0.9107          | 0.5628  | 1e-05  |
| 0.0854        | 98.0  | 26852 | 0.0816   | 0.8571   | 0.7527   | 0.9100          | 0.5639  | 1e-05  |
| 0.0855        | 99.0  | 27126 | 0.0818   | 0.8578   | 0.7556   | 0.9086          | 0.5642  | 1e-05  |
| 0.0855        | 100.0 | 27400 | 0.0816   | 0.8571   | 0.7533   | 0.9080          | 0.5632  | 0.0000 |
| 0.0837        | 101.0 | 27674 | 0.0814   | 0.8575   | 0.7553   | 0.9093          | 0.5645  | 0.0000 |
| 0.0837        | 102.0 | 27948 | 0.0814   | 0.8572   | 0.7559   | 0.9099          | 0.5652  | 0.0000 |
| 0.085         | 103.0 | 28222 | 0.0816   | 0.8570   | 0.7566   | 0.9085          | 0.5645  | 0.0000 |
| 0.085         | 104.0 | 28496 | 0.0812   | 0.8576   | 0.7573   | 0.9102          | 0.5645  | 0.0000 |
| 0.0844        | 105.0 | 28770 | 0.0817   | 0.8572   | 0.7589   | 0.9124          | 0.5604  | 0.0000 |
| 0.0845        | 106.0 | 29044 | 0.0814   | 0.8563   | 0.7514   | 0.9079          | 0.5628  | 0.0000 |
| 0.0845        | 107.0 | 29318 | 0.0817   | 0.8558   | 0.7490   | 0.9058          | 0.5635  | 0.0000 |
| 0.0854        | 108.0 | 29592 | 0.0816   | 0.8569   | 0.7569   | 0.9094          | 0.5642  | 0.0000 |
| 0.0854        | 109.0 | 29866 | 0.0814   | 0.8574   | 0.7558   | 0.9107          | 0.5652  | 0.0000 |
| 0.0854        | 110.0 | 30140 | 0.0813   | 0.8578   | 0.7565   | 0.9118          | 0.5639  | 0.0000 |
| 0.0854        | 111.0 | 30414 | 0.0814   | 0.8576   | 0.7579   | 0.9115          | 0.5639  | 0.0000 |
| 0.0851        | 112.0 | 30688 | 0.0817   | 0.8581   | 0.7576   | 0.9108          | 0.5632  | 0.0000 |
| 0.0851        | 113.0 | 30962 | 0.0815   | 0.8583   | 0.7563   | 0.9128          | 0.5614  | 0.0000 |
| 0.0848        | 114.0 | 31236 | 0.0819   | 0.8564   | 0.7560   | 0.9061          | 0.5656  | 0.0000 |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.1.0+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1