
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# DanSumT5-smallV_45080V_28899V_31593

This model is a fine-tuned version of [MikkelWK/DanSumT5-smallV_45080V_28899](https://huggingface.co/MikkelWK/DanSumT5-smallV_45080V_28899) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3122
- Rouge1: 34.5683
- Rouge2: 11.8919
- Rougel: 21.7397
- Rougelsum: 32.1798
- Gen Len: 126.211

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 6
- eval_batch_size: 6
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 24
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 11

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len  |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:--------:|
| No log        | 1.0   | 79   | 2.3390          | 34.161  | 11.6991 | 21.1038 | 31.9112   | 126.0844 |
| No log        | 1.99  | 158  | 2.3320          | 34.3954 | 11.9233 | 21.5272 | 32.0751   | 126.3418 |
| No log        | 2.99  | 237  | 2.3221          | 34.1517 | 11.771  | 21.3712 | 31.9358   | 126.0127 |
| No log        | 4.0   | 317  | 2.3251          | 34.5229 | 11.9607 | 21.4625 | 32.1584   | 126.0211 |
| No log        | 5.0   | 396  | 2.3203          | 34.467  | 11.9143 | 21.5906 | 32.0152   | 126.1097 |
| No log        | 5.99  | 475  | 2.3195          | 34.3945 | 11.8387 | 21.3495 | 32.1924   | 126.5274 |
| 2.4402        | 6.99  | 554  | 2.3177          | 34.5762 | 11.9914 | 21.5529 | 32.2877   | 126.0084 |
| 2.4402        | 8.0   | 634  | 2.3159          | 34.4465 | 11.7834 | 21.598  | 32.0452   | 125.9283 |
| 2.4402        | 9.0   | 713  | 2.3143          | 34.7267 | 11.9703 | 21.7292 | 32.3818   | 126.3207 |
| 2.4402        | 9.99  | 792  | 2.3123          | 34.5976 | 11.8503 | 21.7384 | 32.2002   | 126.2658 |
| 2.4402        | 10.97 | 869  | 2.3122          | 34.5683 | 11.8919 | 21.7397 | 32.1798   | 126.211  |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.1+cu121
- Datasets 2.15.0
- Tokenizers 0.15.0

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["rouge"], "base_model": "MikkelWK/DanSumT5-smallV_45080V_28899", "model-index": [{"name": "DanSumT5-smallV_45080V_28899V_31593", "results": []}]}
transformers safetensors mt5 text2text-generation generated_from_trainer base_model:MikkelWK/DanSumT5-smallV_45080V_28899 license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us