
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# passive_invoices_v3.13

This model is a fine-tuned version of [microsoft/layoutlmv3-base](https://huggingface.co/microsoft/layoutlmv3-base) on the sroie dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1077
- Precision: 0.8741
- Recall: 0.9069
- F1: 0.8902
- Accuracy: 0.9763

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- training_steps: 15000

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
| 0.9803        | 0.35  | 500   | 0.7980          | 0.2273    | 0.1380 | 0.1717 | 0.7997   |
| 0.4919        | 0.69  | 1000  | 0.4914          | 0.4702    | 0.3894 | 0.4260 | 0.8750   |
| 0.3168        | 1.04  | 1500  | 0.3545          | 0.5801    | 0.5804 | 0.5803 | 0.9090   |
| 0.2169        | 1.39  | 2000  | 0.2742          | 0.6590    | 0.6537 | 0.6563 | 0.9265   |
| 0.1806        | 1.73  | 2500  | 0.2331          | 0.6933    | 0.7045 | 0.6989 | 0.9348   |
| 0.1345        | 2.08  | 3000  | 0.1929          | 0.7436    | 0.7347 | 0.7391 | 0.9471   |
| 0.1072        | 2.43  | 3500  | 0.1812          | 0.7672    | 0.7642 | 0.7657 | 0.9520   |
| 0.0995        | 2.77  | 4000  | 0.1594          | 0.7696    | 0.8021 | 0.7855 | 0.9566   |
| 0.0852        | 3.12  | 4500  | 0.1490          | 0.8021    | 0.8235 | 0.8127 | 0.9613   |
| 0.0726        | 3.47  | 5000  | 0.1471          | 0.7882    | 0.8337 | 0.8103 | 0.9616   |
| 0.0683        | 3.81  | 5500  | 0.1404          | 0.7920    | 0.8447 | 0.8175 | 0.9637   |
| 0.0552        | 4.16  | 6000  | 0.1333          | 0.8100    | 0.8510 | 0.8300 | 0.9660   |
| 0.0588        | 4.51  | 6500  | 0.1261          | 0.8289    | 0.8603 | 0.8443 | 0.9678   |
| 0.0533        | 4.85  | 7000  | 0.1164          | 0.8479    | 0.8670 | 0.8573 | 0.9708   |
| 0.0485        | 5.2   | 7500  | 0.1225          | 0.8511    | 0.8542 | 0.8527 | 0.9706   |
| 0.0426        | 5.55  | 8000  | 0.1163          | 0.8467    | 0.8763 | 0.8613 | 0.9721   |
| 0.0406        | 5.89  | 8500  | 0.1172          | 0.8460    | 0.8844 | 0.8648 | 0.9709   |
| 0.0417        | 6.24  | 9000  | 0.1168          | 0.8459    | 0.8850 | 0.8650 | 0.9718   |
| 0.0379        | 6.59  | 9500  | 0.1119          | 0.8531    | 0.8927 | 0.8724 | 0.9732   |
| 0.0336        | 6.93  | 10000 | 0.1129          | 0.8587    | 0.8931 | 0.8756 | 0.9737   |
| 0.0325        | 7.28  | 10500 | 0.1083          | 0.8694    | 0.8989 | 0.8839 | 0.9757   |
| 0.0279        | 7.63  | 11000 | 0.1136          | 0.8608    | 0.8961 | 0.8781 | 0.9745   |
| 0.0338        | 7.98  | 11500 | 0.1093          | 0.8654    | 0.9008 | 0.8827 | 0.9756   |
| 0.0294        | 8.32  | 12000 | 0.1013          | 0.8797    | 0.9008 | 0.8901 | 0.9770   |
| 0.0243        | 8.67  | 12500 | 0.1054          | 0.8734    | 0.9017 | 0.8873 | 0.9766   |
| 0.026         | 9.02  | 13000 | 0.1058          | 0.8694    | 0.9048 | 0.8868 | 0.9762   |
| 0.0233        | 9.36  | 13500 | 0.1058          | 0.8793    | 0.9058 | 0.8924 | 0.9773   |
| 0.0245        | 9.71  | 14000 | 0.1060          | 0.8768    | 0.9056 | 0.8910 | 0.9765   |
| 0.0261        | 10.06 | 14500 | 0.1069          | 0.8740    | 0.9069 | 0.8902 | 0.9762   |
| 0.0228        | 10.4  | 15000 | 0.1077          | 0.8741    | 0.9069 | 0.8902 | 0.9763   |


### Framework versions

- Transformers 4.28.0
- Pytorch 2.1.0+cu121
- Datasets 2.2.2
- Tokenizers 0.13.3

{"license": "cc-by-nc-sa-4.0", "tags": ["generated_from_trainer"], "datasets": ["sroie"], "metrics": ["precision", "recall", "f1", "accuracy"], "model-index": [{"name": "passive_invoices_v3.13", "results": [{"task": {"type": "token-classification", "name": "Token Classification"}, "dataset": {"name": "sroie", "type": "sroie", "config": "discharge", "split": "test", "args": "discharge"}, "metrics": [{"type": "precision", "value": 0.8741381471731228, "name": "Precision"}, {"type": "recall", "value": 0.9068799583821043, "name": "Recall"}, {"type": "f1", "value": 0.8902080939614451, "name": "F1"}, {"type": "accuracy", "value": 0.97628824730979, "name": "Accuracy"}]}]}]}
transformers pytorch tensorboard layoutlmv3 token-classification generated_from_trainer dataset:sroie license:cc-by-nc-sa-4.0 model-index autotrain_compatible endpoints_compatible region:us