
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# DanSumT5-smallV_45080

This model is a fine-tuned version of [Danish-summarisation/DanSumT5-small](https://huggingface.co/Danish-summarisation/DanSumT5-small) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3947
- Rouge1: 34.3209
- Rouge2: 11.8208
- Rougel: 21.3959
- Rougelsum: 31.9631
- Gen Len: 125.6287

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 11

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len  |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:--------:|
| No log        | 0.99  | 118  | 2.5732          | 33.7621 | 10.4902 | 19.9228 | 31.1852   | 126.4768 |
| No log        | 2.0   | 237  | 2.5147          | 33.9018 | 10.8823 | 20.4156 | 31.3958   | 126.9958 |
| No log        | 3.0   | 356  | 2.4724          | 34.1672 | 11.018  | 20.6827 | 31.5857   | 125.9958 |
| No log        | 4.0   | 475  | 2.4501          | 34.0634 | 11.0767 | 20.89   | 31.474    | 126.346  |
| 2.8052        | 4.99  | 593  | 2.4293          | 34.2111 | 11.5455 | 21.1122 | 31.7773   | 126.5781 |
| 2.8052        | 6.0   | 712  | 2.4206          | 34.4469 | 11.8443 | 21.2183 | 31.9607   | 126.4051 |
| 2.8052        | 7.0   | 831  | 2.4104          | 34.4776 | 11.801  | 21.382  | 32.0212   | 126.6456 |
| 2.8052        | 8.0   | 950  | 2.4056          | 34.3295 | 11.694  | 21.1718 | 32.0181   | 125.7848 |
| 2.6273        | 8.99  | 1068 | 2.3967          | 34.4282 | 11.7636 | 21.2507 | 32.0646   | 126.2869 |
| 2.6273        | 10.0  | 1187 | 2.3950          | 34.473  | 11.812  | 21.3493 | 32.0687   | 125.7342 |
| 2.6273        | 10.93 | 1298 | 2.3947          | 34.3209 | 11.8208 | 21.3959 | 31.9631   | 125.6287 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.1+cu121
- Datasets 2.15.0
- Tokenizers 0.15.0

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["rouge"], "base_model": "Danish-summarisation/DanSumT5-small", "model-index": [{"name": "DanSumT5-smallV_45080", "results": []}]}
transformers safetensors mt5 text2text-generation generated_from_trainer base_model:Danish-summarisation/DanSumT5-small license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us