transformers tensorboard safetensors t5 text2text-generation generated_from_trainer base_model:t5-small license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
base_model: t5-small
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: t5-small-finetuned-samsun-10epoch-32
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-small-finetuned-samsun-10epoch-32

This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.7427
- Rouge1: 41.259
- Rouge2: 18.6668
- Rougel: 34.8705
- Rougelsum: 38.2147
- Gen Len: 16.6051

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
| 2.2715        | 1.0   | 921  | 1.8796          | 39.1544 | 16.6193 | 32.6399 | 36.2408   | 16.3888 |
| 2.042         | 2.0   | 1842 | 1.8251          | 40.2761 | 17.3143 | 33.5239 | 37.3139   | 16.4218 |
| 1.987         | 3.0   | 2763 | 1.7981          | 40.3499 | 17.8091 | 34.0216 | 37.6063   | 16.4095 |
| 1.9529        | 4.0   | 3684 | 1.7779          | 40.9741 | 18.1594 | 34.3685 | 37.8782   | 16.4401 |
| 1.9298        | 5.0   | 4605 | 1.7657          | 41.3166 | 18.6125 | 34.8556 | 38.2854   | 16.4914 |
| 1.9105        | 6.0   | 5526 | 1.7566          | 41.4267 | 18.5259 | 34.7167 | 38.2684   | 16.6711 |
| 1.8945        | 7.0   | 6447 | 1.7508          | 41.075  | 18.4725 | 34.6262 | 38.043    | 16.5037 |
| 1.8815        | 8.0   | 7368 | 1.7474          | 41.4103 | 18.5046 | 34.8252 | 38.2475   | 16.5513 |
| 1.8805        | 9.0   | 8289 | 1.7422          | 41.4699 | 18.7027 | 34.921  | 38.3892   | 16.6467 |
| 1.8786        | 10.0  | 9210 | 1.7427          | 41.259  | 18.6668 | 34.8705 | 38.2147   | 16.6051 |


### Framework versions

- Transformers 4.37.2
- Pytorch 2.1.0+cu121
- Datasets 2.17.1
- Tokenizers 0.15.2
