transformers tensorboard safetensors t5 text2text-generation generated_from_trainer autotrain_compatible endpoints_compatible text-generation-inference region:us
---
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: flan-t5-base-dialogsum_v2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# flan-t5-base-dialogsum_v2

This model was trained from scratch on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9323
- Rouge1: 49.6194
- Rouge2: 23.9441
- Rougel: 47.1784
- Rougelsum: 47.7351
- Gen Len: 19.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 25

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
| 0.8419        | 1.0   | 1558  | 0.9686          | 49.1717 | 21.6321 | 46.5027 | 46.9099   | 19.0    |
| 0.7931        | 2.0   | 3116  | 0.9393          | 49.0429 | 25.016  | 46.8583 | 47.1894   | 19.0    |
| 0.7931        | 3.0   | 4674  | 0.9555          | 49.969  | 24.7039 | 47.6287 | 48.1426   | 19.0    |
| 0.7572        | 4.0   | 6232  | 0.9746          | 49.1309 | 23.2537 | 46.4771 | 46.9249   | 19.0    |
| 0.7417        | 5.0   | 7790  | 0.9820          | 49.2093 | 23.1137 | 46.6788 | 47.1939   | 19.0    |
| 0.7491        | 6.0   | 9348  | 0.9592          | 50.4655 | 25.5968 | 48.0925 | 48.6231   | 19.0    |
| 0.7181        | 7.0   | 10906 | 0.9593          | 50.6565 | 24.5502 | 48.0572 | 48.5985   | 19.0    |
| 0.7144        | 8.0   | 12464 | 0.9386          | 50.9351 | 25.9342 | 48.4183 | 48.898    | 19.0    |
| 0.7137        | 9.0   | 14022 | 0.9486          | 49.5404 | 23.7464 | 46.9305 | 47.4827   | 19.0    |
| 0.6728        | 10.0  | 15580 | 0.9419          | 49.9498 | 23.8617 | 47.3421 | 47.9081   | 19.0    |
| 0.6783        | 11.0  | 17138 | 0.9459          | 50.52   | 25.9799 | 48.0356 | 48.596    | 19.0    |
| 0.6708        | 12.0  | 18696 | 0.9552          | 49.85   | 23.8992 | 47.3564 | 47.8535   | 19.0    |
| 0.6515        | 13.0  | 20254 | 0.9462          | 49.7239 | 25.468  | 47.4924 | 48.0146   | 19.0    |
| 0.6419        | 14.0  | 21812 | 0.9507          | 49.8791 | 25.3529 | 47.5795 | 48.0845   | 19.0    |
| 0.6297        | 15.0  | 23370 | 0.9323          | 49.6194 | 23.9441 | 47.1784 | 47.7351   | 19.0    |
| 0.6354        | 16.0  | 24928 | 0.9408          | 50.3383 | 25.6301 | 48.1241 | 48.6641   | 19.0    |
| 0.6178        | 17.0  | 26486 | 0.9420          | 49.5266 | 24.6134 | 47.1452 | 47.6481   | 19.0    |
| 0.608         | 18.0  | 28044 | 0.9549          | 49.7907 | 24.9381 | 47.4622 | 48.0312   | 19.0    |
| 0.6205        | 19.0  | 29602 | 0.9580          | 49.687  | 25.1737 | 47.4014 | 47.8466   | 19.0    |
| 0.5946        | 20.0  | 31160 | 0.9519          | 50.1159 | 25.3671 | 47.8232 | 48.3411   | 19.0    |
| 0.6107        | 21.0  | 32718 | 0.9549          | 49.9508 | 24.746  | 47.5774 | 48.1047   | 19.0    |
| 0.591         | 22.0  | 34276 | 0.9543          | 50.1561 | 25.3451 | 47.8341 | 48.3492   | 19.0    |
| 0.6017        | 23.0  | 35834 | 0.9570          | 49.893  | 25.1383 | 47.503  | 48.059    | 19.0    |
| 0.5942        | 24.0  | 37392 | 0.9584          | 49.9479 | 24.9422 | 47.5917 | 48.1012   | 19.0    |
| 0.5826        | 25.0  | 38950 | 0.9592          | 49.9049 | 25.1102 | 47.5736 | 48.1165   | 19.0    |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.0.1+cu117
- Datasets 2.15.0
- Tokenizers 0.15.0
