metadata

license: apache-2.0
base_model: t5-small
tags:
  - generated_from_trainer
metrics:
  - bleu
  - sacrebleu
model-index:
  - name: my_awesome_opus_books_model
    results: []
datasets:
  - opus_books
language:
  - en
library_name: transformers

my_awesome_opus_books_model

This model is a fine-tuned version of t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.6087
Bleu: 5.6503
Gen Len: 17.561

Sample Request

Try this sentence - translate English to French: what is love?

You should get response like - Qu'est-ce que l'amour?

Ensure that you are prepending translate English to French: for all translations

Intended uses & limitations

This model has been trained only on en-fr subset of OPUS dataset.

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 2
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Bleu	Gen Len
1.8471	1.0	6355	1.6325	5.4857	17.565
1.8346	2.0	12710	1.6087	5.6503	17.561

Framework versions

Transformers 4.36.2
Pytorch 2.1.0+cu121
Datasets 2.16.0
Tokenizers 0.15.0