
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ALL_mt5-base_15_spider_15_wikiSQL_new

This model was trained from scratch on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2909
- Rouge2 Precision: 0.6313
- Rouge2 Recall: 0.4304
- Rouge2 Fmeasure: 0.4825

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 19
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Rouge2 Precision | Rouge2 Recall | Rouge2 Fmeasure |
|:-------------:|:-----:|:-----:|:---------------:|:----------------:|:-------------:|:---------------:|
| 0.2246        | 1.0   | 1021  | 0.2285          | 0.5427           | 0.3561        | 0.4023          |
| 0.1399        | 2.0   | 2042  | 0.2178          | 0.5685           | 0.3784        | 0.4254          |
| 0.1064        | 3.0   | 3063  | 0.2239          | 0.5832           | 0.3955        | 0.443           |
| 0.0849        | 4.0   | 4084  | 0.2297          | 0.6109           | 0.4157        | 0.466           |
| 0.0725        | 5.0   | 5105  | 0.2445          | 0.6023           | 0.4067        | 0.4567          |
| 0.0614        | 6.0   | 6126  | 0.2444          | 0.607            | 0.4123        | 0.4621          |
| 0.053         | 7.0   | 7147  | 0.2522          | 0.6158           | 0.419         | 0.4694          |
| 0.0479        | 8.0   | 8168  | 0.2612          | 0.6187           | 0.4194        | 0.4706          |
| 0.043         | 9.0   | 9189  | 0.2636          | 0.6249           | 0.4268        | 0.4782          |
| 0.0402        | 10.0  | 10210 | 0.2697          | 0.6304           | 0.4296        | 0.4818          |
| 0.0368        | 11.0  | 11231 | 0.2770          | 0.6299           | 0.43          | 0.482           |
| 0.0348        | 12.0  | 12252 | 0.2836          | 0.6284           | 0.4274        | 0.4795          |
| 0.0329        | 13.0  | 13273 | 0.2879          | 0.6233           | 0.4242        | 0.4758          |
| 0.0324        | 14.0  | 14294 | 0.2913          | 0.6303           | 0.4296        | 0.4818          |
| 0.0313        | 15.0  | 15315 | 0.2909          | 0.6313           | 0.4304        | 0.4825          |


### Framework versions

- Transformers 4.26.1
- Pytorch 2.0.1+cu117
- Datasets 2.14.7.dev0
- Tokenizers 0.13.3

{"tags": ["generated_from_trainer"], "model-index": [{"name": "ALL_mt5-base_15_spider_15_wikiSQL_new", "results": []}]}
transformers pytorch tensorboard t5 text2text-generation generated_from_trainer autotrain_compatible endpoints_compatible text-generation-inference region:us