transformers safetensors m2m_100 text2text-generation generated_from_trainer base_model:facebook/m2m100_1.2B license:mit autotrain_compatible endpoints_compatible region:us
---
license: mit
base_model: facebook/m2m100_1.2B
tags:
- generated_from_trainer
metrics:
- bleu
model-index:
- name: cs_m2m_0.00001_200_v0.2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# cs_m2m_0.00001_200_v0.2

This model is a fine-tuned version of [facebook/m2m100_1.2B](https://huggingface.co/facebook/m2m100_1.2B) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 8.4603
- Bleu: 0.1346
- Gen Len: 69.619

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 200

### Training results

| Training Loss | Epoch | Step | Validation Loss | Bleu   | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
| 2.684         | 1.0   | 6    | 8.4517          | 0.0956 | 61.6667 |
| 1.978         | 2.0   | 12   | 8.4546          | 0.0985 | 61.8095 |
| 2.8654        | 3.0   | 18   | 8.4538          | 0.0961 | 62.4286 |
| 2.8165        | 4.0   | 24   | 8.4550          | 0.0991 | 63.1905 |
| 2.6606        | 5.0   | 30   | 8.4556          | 0.0956 | 61.0476 |
| 3.1159        | 6.0   | 36   | 8.4525          | 0.0964 | 60.5238 |
| 1.813         | 7.0   | 42   | 8.4524          | 0.0961 | 59.8095 |
| 2.9637        | 8.0   | 48   | 8.4520          | 0.0961 | 59.8095 |
| 2.1663        | 9.0   | 54   | 8.4526          | 0.0918 | 59.5714 |
| 2.475         | 10.0  | 60   | 8.4516          | 0.0916 | 59.381  |
| 2.5769        | 11.0  | 66   | 8.4493          | 0.0927 | 60.1905 |
| 2.414         | 12.0  | 72   | 8.4485          | 0.0927 | 60.1905 |
| 2.5985        | 13.0  | 78   | 8.4500          | 0.0946 | 60.1905 |
| 2.6263        | 14.0  | 84   | 8.4527          | 0.1003 | 61.0    |
| 2.2439        | 15.0  | 90   | 8.4533          | 0.0774 | 69.0952 |
| 1.9865        | 16.0  | 96   | 8.4542          | 0.0769 | 69.5238 |
| 2.2472        | 17.0  | 102  | 8.4540          | 0.0766 | 69.7619 |
| 2.5489        | 18.0  | 108  | 8.4534          | 0.0782 | 70.3333 |
| 1.9181        | 19.0  | 114  | 8.4527          | 0.0789 | 70.5714 |
| 2.0332        | 20.0  | 120  | 8.4505          | 0.0785 | 70.7619 |
| 1.9397        | 21.0  | 126  | 8.4488          | 0.0784 | 70.9048 |
| 2.788         | 22.0  | 132  | 8.4480          | 0.0772 | 71.9524 |
| 2.4842        | 23.0  | 138  | 8.4473          | 0.0778 | 71.6667 |
| 2.3397        | 24.0  | 144  | 8.4459          | 0.0975 | 62.6667 |
| 2.3303        | 25.0  | 150  | 8.4448          | 0.1314 | 71.9048 |
| 2.6417        | 26.0  | 156  | 8.4436          | 0.1311 | 71.9524 |
| 2.0759        | 27.0  | 162  | 8.4446          | 0.128  | 71.9524 |
| 2.0973        | 28.0  | 168  | 8.4450          | 0.1659 | 62.1905 |
| 2.9593        | 29.0  | 174  | 8.4455          | 0.1285 | 71.4762 |
| 3.0086        | 30.0  | 180  | 8.4442          | 0.1624 | 61.8571 |
| 2.684         | 31.0  | 186  | 8.4431          | 0.162  | 62.0952 |
| 2.7015        | 32.0  | 192  | 8.4442          | 0.162  | 62.0952 |
| 4.6745        | 33.0  | 198  | 8.4431          | 0.1624 | 62.9048 |
| 2.1913        | 34.0  | 204  | 8.4427          | 0.1607 | 63.0    |
| 2.1685        | 35.0  | 210  | 8.4443          | 0.1671 | 61.4286 |
| 2.3458        | 36.0  | 216  | 8.4458          | 0.1346 | 69.6667 |
| 2.0533        | 37.0  | 222  | 8.4456          | 0.132  | 70.1905 |
| 3.1101        | 38.0  | 228  | 8.4442          | 0.1335 | 69.8095 |
| 2.2737        | 39.0  | 234  | 8.4447          | 0.0787 | 70.7619 |
| 2.4838        | 40.0  | 240  | 8.4476          | 0.0784 | 70.1905 |
| 1.9048        | 41.0  | 246  | 8.4487          | 0.0801 | 70.4762 |
| 2.825         | 42.0  | 252  | 8.4495          | 0.0668 | 79.4286 |
| 1.7811        | 43.0  | 258  | 8.4521          | 0.0639 | 78.2381 |
| 2.1382        | 44.0  | 264  | 8.4545          | 0.0639 | 78.1429 |
| 2.2783        | 45.0  | 270  | 8.4553          | 0.0636 | 78.5714 |
| 2.1117        | 46.0  | 276  | 8.4558          | 0.0636 | 78.5714 |
| 2.0165        | 47.0  | 282  | 8.4563          | 0.0638 | 78.4762 |
| 2.2424        | 48.0  | 288  | 8.4568          | 0.0639 | 78.3333 |
| 2.7404        | 49.0  | 294  | 8.4564          | 0.0627 | 79.5714 |
| 3.3443        | 50.0  | 300  | 8.4560          | 0.0617 | 78.4762 |
| 2.7281        | 51.0  | 306  | 8.4551          | 0.0617 | 78.4762 |
| 2.9189        | 52.0  | 312  | 8.4520          | 0.0757 | 70.7143 |
| 2.3192        | 53.0  | 318  | 8.4512          | 0.0754 | 70.7619 |
| 2.3737        | 54.0  | 324  | 8.4505          | 0.0604 | 78.4286 |
| 2.4041        | 55.0  | 330  | 8.4490          | 0.0606 | 78.0952 |
| 4.5412        | 56.0  | 336  | 8.4478          | 0.0618 | 78.0952 |
| 2.399         | 57.0  | 342  | 8.4469          | 0.0617 | 78.2381 |
| 1.8226        | 58.0  | 348  | 8.4467          | 0.062  | 77.9048 |
| 2.3362        | 59.0  | 354  | 8.4463          | 0.0612 | 77.4762 |
| 2.4263        | 60.0  | 360  | 8.4450          | 0.0612 | 77.4762 |
| 2.7929        | 61.0  | 366  | 8.4439          | 0.0617 | 78.2381 |
| 3.2633        | 62.0  | 372  | 8.4434          | 0.0615 | 78.3333 |
| 2.3451        | 63.0  | 378  | 8.4436          | 0.0607 | 77.9048 |
| 2.8337        | 64.0  | 384  | 8.4429          | 0.061  | 77.4762 |
| 2.7405        | 65.0  | 390  | 8.4430          | 0.0607 | 77.9048 |
| 2.8955        | 66.0  | 396  | 8.4420          | 0.0614 | 78.6667 |
| 2.3475        | 67.0  | 402  | 8.4408          | 0.061  | 79.0952 |
| 2.0904        | 68.0  | 408  | 8.4383          | 0.0608 | 79.1905 |
| 2.4816        | 69.0  | 414  | 8.4367          | 0.0607 | 79.3333 |
| 2.3696        | 70.0  | 420  | 8.4365          | 0.0607 | 79.3333 |
| 2.7587        | 71.0  | 426  | 8.4364          | 0.0616 | 79.5714 |
| 2.0684        | 72.0  | 432  | 8.4369          | 0.0617 | 79.4762 |
| 2.5021        | 73.0  | 438  | 8.4375          | 0.0617 | 79.4762 |
| 1.4037        | 74.0  | 444  | 8.4362          | 0.0759 | 71.0476 |
| 2.1197        | 75.0  | 450  | 8.4357          | 0.0763 | 70.7619 |
| 2.2019        | 76.0  | 456  | 8.4378          | 0.0612 | 78.8571 |
| 1.8674        | 77.0  | 462  | 8.4402          | 0.062  | 77.7619 |
| 4.6628        | 78.0  | 468  | 8.4415          | 0.0769 | 69.3333 |
| 2.5704        | 79.0  | 474  | 8.4420          | 0.0769 | 69.3333 |
| 1.8771        | 80.0  | 480  | 8.4422          | 0.0772 | 69.1905 |
| 1.9444        | 81.0  | 486  | 8.4437          | 0.078  | 70.5238 |
| 2.0133        | 82.0  | 492  | 8.4443          | 0.0771 | 71.1429 |
| 2.8815        | 83.0  | 498  | 8.4445          | 0.0757 | 70.4286 |
| 3.0573        | 84.0  | 504  | 8.4455          | 0.0621 | 77.7143 |
| 2.011         | 85.0  | 510  | 8.4469          | 0.0621 | 77.7143 |
| 1.8176        | 86.0  | 516  | 8.4488          | 0.0621 | 77.7143 |
| 1.505         | 87.0  | 522  | 8.4512          | 0.0621 | 77.7143 |
| 5.016         | 88.0  | 528  | 8.4542          | 0.0622 | 77.5714 |
| 4.8956        | 89.0  | 534  | 8.4565          | 0.0625 | 77.1905 |
| 2.3939        | 90.0  | 540  | 8.4578          | 0.0625 | 77.1905 |
| 1.8629        | 91.0  | 546  | 8.4589          | 0.0622 | 77.5714 |
| 2.7315        | 92.0  | 552  | 8.4599          | 0.0617 | 78.1429 |
| 2.6185        | 93.0  | 558  | 8.4605          | 0.0618 | 78.1429 |
| 2.2754        | 94.0  | 564  | 8.4598          | 0.0617 | 78.2381 |
| 1.9322        | 95.0  | 570  | 8.4582          | 0.0616 | 78.381  |
| 2.1725        | 96.0  | 576  | 8.4583          | 0.0621 | 78.9524 |
| 2.603         | 97.0  | 582  | 8.4576          | 0.0619 | 79.1905 |
| 2.543         | 98.0  | 588  | 8.4569          | 0.0619 | 79.1905 |
| 2.4981        | 99.0  | 594  | 8.4563          | 0.0618 | 79.2857 |
| 1.8449        | 100.0 | 600  | 8.4561          | 0.063  | 80.0952 |
| 3.063         | 101.0 | 606  | 8.4559          | 0.0618 | 79.2857 |
| 1.7031        | 102.0 | 612  | 8.4564          | 0.0622 | 77.7143 |
| 2.6749        | 103.0 | 618  | 8.4563          | 0.0623 | 77.5714 |
| 2.5504        | 104.0 | 624  | 8.4558          | 0.0781 | 69.4286 |
| 1.785         | 105.0 | 630  | 8.4559          | 0.0791 | 69.4286 |
| 2.3876        | 106.0 | 636  | 8.4560          | 0.0753 | 70.5238 |
| 1.9649        | 107.0 | 642  | 8.4556          | 0.0613 | 78.4762 |
| 2.5544        | 108.0 | 648  | 8.4571          | 0.0617 | 78.3333 |
| 2.3048        | 109.0 | 654  | 8.4578          | 0.0619 | 77.9524 |
| 3.2234        | 110.0 | 660  | 8.4595          | 0.0618 | 77.9524 |
| 2.5271        | 111.0 | 666  | 8.4600          | 0.0619 | 77.7619 |
| 2.1592        | 112.0 | 672  | 8.4599          | 0.0621 | 77.8571 |
| 2.1582        | 113.0 | 678  | 8.4600          | 0.0618 | 77.9524 |
| 5.1356        | 114.0 | 684  | 8.4596          | 0.0622 | 77.6667 |
| 3.1661        | 115.0 | 690  | 8.4594          | 0.0622 | 77.7619 |
| 2.1159        | 116.0 | 696  | 8.4597          | 0.0617 | 78.2381 |
| 2.1355        | 117.0 | 702  | 8.4602          | 0.0612 | 78.7143 |
| 2.5071        | 118.0 | 708  | 8.4606          | 0.0631 | 79.9524 |
| 2.5419        | 119.0 | 714  | 8.4608          | 0.0631 | 80.0476 |
| 2.1749        | 120.0 | 720  | 8.4616          | 0.0617 | 79.381  |
| 2.1737        | 121.0 | 726  | 8.4622          | 0.0631 | 80.0476 |
| 2.2413        | 122.0 | 732  | 8.4623          | 0.0633 | 79.8095 |
| 2.2636        | 123.0 | 738  | 8.4624          | 0.0636 | 79.4762 |
| 2.9731        | 124.0 | 744  | 8.4624          | 0.0636 | 79.4762 |
| 2.6207        | 125.0 | 750  | 8.4621          | 0.0636 | 79.4762 |
| 2.6231        | 126.0 | 756  | 8.4602          | 0.0636 | 79.4762 |
| 2.4161        | 127.0 | 762  | 8.4605          | 0.0637 | 79.381  |
| 2.9764        | 128.0 | 768  | 8.4613          | 0.0762 | 70.9524 |
| 2.41          | 129.0 | 774  | 8.4618          | 0.0761 | 71.0476 |
| 2.1357        | 130.0 | 780  | 8.4620          | 0.0762 | 70.7143 |
| 3.211         | 131.0 | 786  | 8.4621          | 0.0762 | 70.7143 |
| 1.8992        | 132.0 | 792  | 8.4623          | 0.0633 | 79.7143 |
| 2.9689        | 133.0 | 798  | 8.4621          | 0.0631 | 79.9524 |
| 2.4456        | 134.0 | 804  | 8.4619          | 0.0629 | 80.0476 |
| 1.9567        | 135.0 | 810  | 8.4620          | 0.063  | 79.8571 |
| 4.3724        | 136.0 | 816  | 8.4619          | 0.0626 | 79.2381 |
| 2.2729        | 137.0 | 822  | 8.4623          | 0.0626 | 79.2381 |
| 2.2375        | 138.0 | 828  | 8.4620          | 0.0625 | 78.2381 |
| 2.0507        | 139.0 | 834  | 8.4617          | 0.0625 | 78.2381 |
| 3.2081        | 140.0 | 840  | 8.4621          | 0.1072 | 78.0952 |
| 3.0478        | 141.0 | 846  | 8.4629          | 0.1072 | 78.0952 |
| 1.6707        | 142.0 | 852  | 8.4628          | 0.1042 | 77.5238 |
| 2.7035        | 143.0 | 858  | 8.4626          | 0.1042 | 77.5238 |
| 2.0088        | 144.0 | 864  | 8.4627          | 0.1042 | 77.5238 |
| 2.2061        | 145.0 | 870  | 8.4619          | 0.1042 | 77.5238 |
| 2.9719        | 146.0 | 876  | 8.4597          | 0.1055 | 76.7143 |
| 1.7429        | 147.0 | 882  | 8.4591          | 0.1335 | 69.0952 |
| 2.0689        | 148.0 | 888  | 8.4590          | 0.1094 | 77.7143 |
| 3.0878        | 149.0 | 894  | 8.4593          | 0.1094 | 77.7143 |
| 2.3762        | 150.0 | 900  | 8.4593          | 0.1083 | 78.381  |
| 1.9409        | 151.0 | 906  | 8.4591          | 0.1083 | 78.381  |
| 2.472         | 152.0 | 912  | 8.4590          | 0.1328 | 70.1905 |
| 2.1888        | 153.0 | 918  | 8.4590          | 0.1341 | 69.619  |
| 2.8783        | 154.0 | 924  | 8.4582          | 0.1341 | 69.619  |
| 2.4719        | 155.0 | 930  | 8.4582          | 0.1318 | 68.9524 |
| 2.4873        | 156.0 | 936  | 8.4579          | 0.1318 | 68.9524 |
| 2.202         | 157.0 | 942  | 8.4576          | 0.1318 | 68.9524 |
| 2.4128        | 158.0 | 948  | 8.4577          | 0.1318 | 68.9524 |
| 1.6922        | 159.0 | 954  | 8.4577          | 0.1318 | 68.9524 |
| 2.5719        | 160.0 | 960  | 8.4582          | 0.1318 | 68.9524 |
| 1.8392        | 161.0 | 966  | 8.4581          | 0.1318 | 68.9524 |
| 2.1349        | 162.0 | 972  | 8.4581          | 0.1318 | 68.9524 |
| 2.0836        | 163.0 | 978  | 8.4586          | 0.1318 | 68.9524 |
| 2.5173        | 164.0 | 984  | 8.4590          | 0.1318 | 68.9524 |
| 1.9422        | 165.0 | 990  | 8.4591          | 0.1318 | 68.9524 |
| 2.4949        | 166.0 | 996  | 8.4591          | 0.1318 | 68.9524 |
| 2.6692        | 167.0 | 1002 | 8.4586          | 0.1318 | 68.9524 |
| 1.5472        | 168.0 | 1008 | 8.4588          | 0.1318 | 68.9524 |
| 5.0693        | 169.0 | 1014 | 8.4589          | 0.1318 | 68.9524 |
| 2.6937        | 170.0 | 1020 | 8.4593          | 0.1318 | 68.9524 |
| 5.0729        | 171.0 | 1026 | 8.4596          | 0.1306 | 69.5238 |
| 2.645         | 172.0 | 1032 | 8.4599          | 0.1306 | 69.5238 |
| 1.671         | 173.0 | 1038 | 8.4600          | 0.1306 | 69.5238 |
| 2.329         | 174.0 | 1044 | 8.4600          | 0.1306 | 69.5238 |
| 2.2443        | 175.0 | 1050 | 8.4597          | 0.1306 | 69.5238 |
| 2.0599        | 176.0 | 1056 | 8.4594          | 0.1306 | 69.5238 |
| 2.0761        | 177.0 | 1062 | 8.4598          | 0.1639 | 60.7619 |
| 2.3301        | 178.0 | 1068 | 8.4595          | 0.1306 | 69.5238 |
| 2.8817        | 179.0 | 1074 | 8.4595          | 0.1306 | 69.5238 |
| 2.3847        | 180.0 | 1080 | 8.4588          | 0.1312 | 69.5238 |
| 2.7967        | 181.0 | 1086 | 8.4586          | 0.1312 | 69.5238 |
| 1.6165        | 182.0 | 1092 | 8.4590          | 0.1308 | 69.6667 |
| 3.2699        | 183.0 | 1098 | 8.4585          | 0.1308 | 69.6667 |
| 2.1596        | 184.0 | 1104 | 8.4587          | 0.1308 | 69.6667 |
| 4.383         | 185.0 | 1110 | 8.4587          | 0.1308 | 69.6667 |
| 2.5019        | 186.0 | 1116 | 8.4587          | 0.1308 | 69.6667 |
| 2.1497        | 187.0 | 1122 | 8.4587          | 0.1308 | 69.6667 |
| 2.7942        | 188.0 | 1128 | 8.4594          | 0.1342 | 69.7619 |
| 2.5737        | 189.0 | 1134 | 8.4595          | 0.1342 | 69.7619 |
| 2.7013        | 190.0 | 1140 | 8.4597          | 0.1342 | 69.7619 |
| 4.7672        | 191.0 | 1146 | 8.4598          | 0.1342 | 69.7619 |
| 4.723         | 192.0 | 1152 | 8.4598          | 0.1342 | 69.7619 |
| 2.2355        | 193.0 | 1158 | 8.4598          | 0.1342 | 69.7619 |
| 1.7872        | 194.0 | 1164 | 8.4599          | 0.1342 | 69.7619 |
| 2.0794        | 195.0 | 1170 | 8.4600          | 0.1342 | 69.7619 |
| 1.6962        | 196.0 | 1176 | 8.4601          | 0.1342 | 69.7619 |
| 2.2855        | 197.0 | 1182 | 8.4602          | 0.1342 | 69.7619 |
| 2.8048        | 198.0 | 1188 | 8.4603          | 0.1346 | 69.619  |
| 1.8135        | 199.0 | 1194 | 8.4603          | 0.1346 | 69.619  |
| 2.395         | 200.0 | 1200 | 8.4603          | 0.1346 | 69.619  |


### Framework versions

- Transformers 4.35.2
- Pytorch 1.13.1+cu117
- Datasets 2.16.1
- Tokenizers 0.15.0
