mt5-small-finetuned-amazon-en-es

This model is a fine-tuned version of google/mt5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 3.0303
• Rouge1: 16.5196
• Rouge2: 7.5215
• Rougel: 16.0079
• Rougelsum: 16.051

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
6.9675	1.0	1209	3.2986	15.3385	6.913	14.7691	14.762
3.8997	2.0	2418	3.1665	16.3282	7.5441	15.6592	15.7112
3.5826	3.0	3627	3.1106	17.0861	8.3352	16.3047	16.4229
3.421	4.0	4836	3.0963	17.2229	8.6827	16.7388	16.7204
3.3089	5.0	6045	3.0490	16.5875	7.5263	16.1273	16.0898
3.2437	6.0	7254	3.0401	16.5225	7.7916	15.9384	15.9692
3.2133	7.0	8463	3.0292	16.2008	7.524	15.865	15.8619
3.1851	8.0	9672	3.0303	16.5196	7.5215	16.0079	16.051

Framework versions

• Transformers 4.46.2
• Pytorch 2.5.1+cu121
• Datasets 3.1.0
• Tokenizers 0.20.3