transformers safetensors t5 text2text-generation generated_from_trainer base_model:Gayathri142214002/Question_Generation_ComQ_5 license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
base_model: Gayathri142214002/Question_Generation_ComQ_5
tags:
- generated_from_trainer
model-index:
- name: Question_Generation_ComQ_6_2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Question_Generation_ComQ_6_2

This model is a fine-tuned version of [Gayathri142214002/Question_Generation_ComQ_5](https://huggingface.co/Gayathri142214002/Question_Generation_ComQ_5) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3553

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 1
- eval_batch_size: 1
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 4
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 7

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 0.2627        | 0.25  | 100  | 0.2558          |
| 0.3047        | 0.51  | 200  | 0.2629          |
| 0.2856        | 0.76  | 300  | 0.2784          |
| 0.2711        | 1.02  | 400  | 0.2951          |
| 0.2411        | 1.27  | 500  | 0.3052          |
| 0.2528        | 1.53  | 600  | 0.2968          |
| 0.2443        | 1.78  | 700  | 0.2970          |
| 0.2451        | 2.04  | 800  | 0.3079          |
| 0.2095        | 2.29  | 900  | 0.3276          |
| 0.2152        | 2.54  | 1000 | 0.3198          |
| 0.2288        | 2.8   | 1100 | 0.3175          |
| 0.218         | 3.05  | 1200 | 0.3187          |
| 0.1876        | 3.31  | 1300 | 0.3400          |
| 0.2007        | 3.56  | 1400 | 0.3390          |
| 0.2113        | 3.82  | 1500 | 0.3313          |
| 0.2037        | 4.07  | 1600 | 0.3351          |
| 0.1699        | 4.33  | 1700 | 0.3525          |
| 0.1916        | 4.58  | 1800 | 0.3478          |
| 0.1967        | 4.83  | 1900 | 0.3392          |
| 0.1847        | 5.09  | 2000 | 0.3451          |
| 0.165         | 5.34  | 2100 | 0.3496          |
| 0.1737        | 5.6   | 2200 | 0.3508          |
| 0.1699        | 5.85  | 2300 | 0.3494          |
| 0.1652        | 6.11  | 2400 | 0.3527          |
| 0.1605        | 6.36  | 2500 | 0.3531          |
| 0.1623        | 6.62  | 2600 | 0.3548          |
| 0.1507        | 6.87  | 2700 | 0.3553          |


### Framework versions

- Transformers 4.36.2
- Pytorch 2.1.2+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
