
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# test

This model is a fine-tuned version of [facebook/mbart-large-50](https://huggingface.co/facebook/mbart-large-50) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 2.6033
- Gen Len: 16.2489
- Rouge-1: 66.7759
- Rouge-2: 57.6647
- Rouge-l: 66.5358

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: polynomial
- lr_scheduler_warmup_steps: 1000
- num_epochs: 50
- label_smoothing_factor: 0.1

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Gen Len | Rouge-1 | Rouge-2 | Rouge-l |
|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:-------:|
| No log        | 1.0   | 642   | 3.0667          | 19.0111 | 35.9519 | 19.6892 | 35.3493 |
| No log        | 2.0   | 1284  | 2.9192          | 18.46   | 38.3629 | 21.7823 | 37.8148 |
| No log        | 3.0   | 1926  | 2.7454          | 16.6444 | 43.5482 | 26.9631 | 42.9824 |
| No log        | 4.0   | 2568  | 2.6630          | 15.8156 | 47.1897 | 31.0619 | 46.5345 |
| No log        | 5.0   | 3210  | 2.6111          | 15.8156 | 53.1981 | 37.4511 | 52.4515 |
| No log        | 6.0   | 3852  | 2.6092          | 16.1867 | 54.8265 | 41.4802 | 54.2731 |
| No log        | 7.0   | 4494  | 2.5755          | 16.4822 | 59.8388 | 47.6458 | 59.6515 |
| 2.5233        | 8.0   | 5136  | 2.5558          | 16.0222 | 62.8462 | 51.8095 | 62.3736 |
| 2.5233        | 9.0   | 5778  | 2.5556          | 15.5556 | 61.3212 | 50.2353 | 61.0193 |
| 2.5233        | 10.0  | 6420  | 2.5726          | 16.48   | 64.4714 | 54.9985 | 64.2163 |
| 2.5233        | 11.0  | 7062  | 2.5741          | 16.2044 | 65.4039 | 56.19   | 65.0116 |
| 2.5233        | 12.0  | 7704  | 2.5532          | 16.06   | 66.4355 | 57.0383 | 66.0029 |
| 2.5233        | 13.0  | 8346  | 2.5709          | 16.3333 | 67.0054 | 58.0123 | 66.6583 |
| 2.5233        | 14.0  | 8988  | 2.5810          | 16.3067 | 66.6106 | 58.0058 | 66.3812 |
| 2.5233        | 15.0  | 9630  | 2.5775          | 15.8244 | 66.6611 | 57.6711 | 66.4365 |
| 1.7632        | 16.0  | 10272 | 2.5926          | 16.6178 | 67.1709 | 58.309  | 66.7708 |
| 1.7632        | 17.0  | 10914 | 2.6033          | 16.2489 | 66.7759 | 57.6647 | 66.5358 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.17.0
- Tokenizers 0.15.2

{"license": "mit", "tags": ["generated_from_trainer"], "base_model": "facebook/mbart-large-50", "model-index": [{"name": "test", "results": []}]}
generated_from_trainer base_model:facebook/mbart-large-50 license:mit region:us