
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Roberta-finetuned-Parsi-Mianeh-Corpus

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 7.3460

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 9.7742        | 0.22  | 20   | 9.1221          |
| 8.9449        | 0.44  | 40   | 8.7575          |
| 8.8313        | 0.66  | 60   | 8.4927          |
| 8.4673        | 0.88  | 80   | 8.2024          |
| 8.1893        | 1.1   | 100  | 8.0003          |
| 8.0109        | 1.32  | 120  | 7.7822          |
| 7.7539        | 1.54  | 140  | 7.5710          |
| 7.5504        | 1.76  | 160  | 7.5742          |
| 7.4363        | 1.98  | 180  | 7.4550          |
| 7.3383        | 2.2   | 200  | 7.3248          |
| 7.3509        | 2.42  | 220  | 7.1785          |
| 7.3977        | 2.64  | 240  | 7.1737          |
| 7.2945        | 2.86  | 260  | 7.3460          |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.0
- Tokenizers 0.15.0

{"tags": ["generated_from_trainer"], "model-index": [{"name": "Roberta-finetuned-Parsi-Mianeh-Corpus", "results": []}]}
transformers tensorboard safetensors roberta fill-mask generated_from_trainer autotrain_compatible endpoints_compatible region:us