
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# BconvQA-test1

This model is a fine-tuned version of [csebuetnlp/banglat5](https://huggingface.co/csebuetnlp/banglat5) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.5310
- Rouge1: 0.0
- Rouge2: 0.0
- Rougel: 0.0
- Rougelsum: 0.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|
| 4.5934        | 0.02  | 500   | 3.1206          | 0.0    | 0.0    | 0.0    | 0.0       |
| 3.5083        | 0.04  | 1000  | 2.7508          | 0.0    | 0.0    | 0.0    | 0.0       |
| 3.0041        | 0.06  | 1500  | 2.2013          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.7528        | 0.08  | 2000  | 2.1193          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.627         | 0.1   | 2500  | 2.0304          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.512         | 0.12  | 3000  | 1.9671          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.4875        | 0.14  | 3500  | 1.9609          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.4792        | 0.16  | 4000  | 1.9269          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.3934        | 0.18  | 4500  | 1.8953          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.3819        | 0.2   | 5000  | 1.9143          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.3705        | 0.22  | 5500  | 1.8843          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.3085        | 0.24  | 6000  | 1.8635          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.2669        | 0.26  | 6500  | 1.8422          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.3055        | 0.28  | 7000  | 1.8183          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.2122        | 0.3   | 7500  | 1.8056          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.2501        | 0.32  | 8000  | 1.8190          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.2551        | 0.34  | 8500  | 1.7687          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.2235        | 0.36  | 9000  | 1.7921          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1668        | 0.38  | 9500  | 1.7795          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1769        | 0.4   | 10000 | 1.7699          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.174         | 0.42  | 10500 | 1.7647          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1148        | 0.44  | 11000 | 1.7559          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1575        | 0.46  | 11500 | 1.7525          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1668        | 0.48  | 12000 | 1.7449          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1312        | 0.5   | 12500 | 1.7369          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0505        | 0.52  | 13000 | 1.7579          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.127         | 0.54  | 13500 | 1.7220          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.1154        | 0.56  | 14000 | 1.7024          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.073         | 0.58  | 14500 | 1.6901          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.022         | 0.6   | 15000 | 1.6945          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.09          | 0.62  | 15500 | 1.6906          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9853        | 0.64  | 16000 | 1.7042          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.986         | 0.66  | 16500 | 1.6709          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0296        | 0.68  | 17000 | 1.6855          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0092        | 0.7   | 17500 | 1.6633          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0618        | 0.72  | 18000 | 1.6615          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0111        | 0.74  | 18500 | 1.6602          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9827        | 0.76  | 19000 | 1.6603          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9824        | 0.78  | 19500 | 1.6600          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0011        | 0.8   | 20000 | 1.6492          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9677        | 0.82  | 20500 | 1.6553          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9387        | 0.84  | 21000 | 1.6395          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9908        | 0.86  | 21500 | 1.6323          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9607        | 0.88  | 22000 | 1.6446          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.026         | 0.9   | 22500 | 1.6340          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9505        | 0.92  | 23000 | 1.6312          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9841        | 0.94  | 23500 | 1.6335          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.9657        | 0.96  | 24000 | 1.6173          | 0.0    | 0.0    | 0.0    | 0.0       |
| 2.0185        | 0.98  | 24500 | 1.5978          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.8751        | 1.0   | 25000 | 1.6310          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6338        | 1.02  | 25500 | 1.6247          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.597         | 1.04  | 26000 | 1.6250          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5738        | 1.06  | 26500 | 1.6253          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5772        | 1.08  | 27000 | 1.6437          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6295        | 1.1   | 27500 | 1.6118          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6222        | 1.12  | 28000 | 1.6207          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6236        | 1.14  | 28500 | 1.6300          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5655        | 1.16  | 29000 | 1.6447          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6667        | 1.18  | 29500 | 1.6015          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6366        | 1.2   | 30000 | 1.6212          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5692        | 1.22  | 30500 | 1.6214          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6192        | 1.24  | 31000 | 1.6184          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5496        | 1.26  | 31500 | 1.6241          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5691        | 1.28  | 32000 | 1.6008          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5956        | 1.3   | 32500 | 1.6070          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5474        | 1.32  | 33000 | 1.6279          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5867        | 1.34  | 33500 | 1.5908          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.608         | 1.36  | 34000 | 1.5951          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5829        | 1.38  | 34500 | 1.5933          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5411        | 1.4   | 35000 | 1.5973          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.595         | 1.42  | 35500 | 1.6002          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5776        | 1.44  | 36000 | 1.5759          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.663         | 1.46  | 36500 | 1.5841          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6204        | 1.48  | 37000 | 1.5782          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5709        | 1.5   | 37500 | 1.5720          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6042        | 1.52  | 38000 | 1.5665          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5514        | 1.54  | 38500 | 1.5905          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5266        | 1.56  | 39000 | 1.5818          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6215        | 1.58  | 39500 | 1.5598          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.525         | 1.6   | 40000 | 1.5551          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5542        | 1.62  | 40500 | 1.5612          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5211        | 1.64  | 41000 | 1.5665          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5634        | 1.66  | 41500 | 1.5408          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6331        | 1.68  | 42000 | 1.5511          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.575         | 1.7   | 42500 | 1.5430          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.568         | 1.72  | 43000 | 1.5537          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5421        | 1.74  | 43500 | 1.5273          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.526         | 1.76  | 44000 | 1.5604          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5933        | 1.78  | 44500 | 1.5394          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5524        | 1.8   | 45000 | 1.5534          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.4834        | 1.82  | 45500 | 1.5390          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.548         | 1.84  | 46000 | 1.5445          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5696        | 1.86  | 46500 | 1.5333          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.6166        | 1.88  | 47000 | 1.5268          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5635        | 1.9   | 47500 | 1.5312          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.568         | 1.92  | 48000 | 1.5238          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5338        | 1.94  | 48500 | 1.5298          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5656        | 1.96  | 49000 | 1.5185          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.519         | 1.98  | 49500 | 1.5233          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.5002        | 2.0   | 50000 | 1.5400          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2758        | 2.02  | 50500 | 1.5766          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.27          | 2.04  | 51000 | 1.5684          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2779        | 2.06  | 51500 | 1.5595          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2741        | 2.08  | 52000 | 1.5661          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2291        | 2.1   | 52500 | 1.5849          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2687        | 2.12  | 53000 | 1.5751          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2595        | 2.14  | 53500 | 1.5607          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2416        | 2.16  | 54000 | 1.5658          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2226        | 2.18  | 54500 | 1.5665          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2682        | 2.21  | 55000 | 1.5478          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2313        | 2.23  | 55500 | 1.5642          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2209        | 2.25  | 56000 | 1.5581          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1917        | 2.27  | 56500 | 1.5596          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2526        | 2.29  | 57000 | 1.5521          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2747        | 2.31  | 57500 | 1.5558          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1955        | 2.33  | 58000 | 1.5568          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2547        | 2.35  | 58500 | 1.5440          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2016        | 2.37  | 59000 | 1.5474          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1686        | 2.39  | 59500 | 1.5698          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2548        | 2.41  | 60000 | 1.5488          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2919        | 2.43  | 60500 | 1.5437          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1879        | 2.45  | 61000 | 1.5495          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2326        | 2.47  | 61500 | 1.5470          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2175        | 2.49  | 62000 | 1.5454          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1769        | 2.51  | 62500 | 1.5505          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2468        | 2.53  | 63000 | 1.5500          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2036        | 2.55  | 63500 | 1.5353          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2255        | 2.57  | 64000 | 1.5475          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1757        | 2.59  | 64500 | 1.5375          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2501        | 2.61  | 65000 | 1.5379          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.196         | 2.63  | 65500 | 1.5420          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2497        | 2.65  | 66000 | 1.5387          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2324        | 2.67  | 66500 | 1.5351          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2453        | 2.69  | 67000 | 1.5389          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2335        | 2.71  | 67500 | 1.5356          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2093        | 2.73  | 68000 | 1.5356          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2205        | 2.75  | 68500 | 1.5355          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2411        | 2.77  | 69000 | 1.5360          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2124        | 2.79  | 69500 | 1.5375          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2141        | 2.81  | 70000 | 1.5325          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2272        | 2.83  | 70500 | 1.5370          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.236         | 2.85  | 71000 | 1.5291          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1808        | 2.87  | 71500 | 1.5315          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1279        | 2.89  | 72000 | 1.5317          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1767        | 2.91  | 72500 | 1.5305          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.2048        | 2.93  | 73000 | 1.5299          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1801        | 2.95  | 73500 | 1.5304          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1675        | 2.97  | 74000 | 1.5313          | 0.0    | 0.0    | 0.0    | 0.0       |
| 1.1883        | 2.99  | 74500 | 1.5310          | 0.0    | 0.0    | 0.0    | 0.0       |


### Framework versions

- Transformers 4.37.2
- Pytorch 2.1.1+cu121
- Datasets 2.16.1
- Tokenizers 0.15.1

{"tags": ["generated_from_trainer"], "metrics": ["rouge"], "base_model": "csebuetnlp/banglat5", "model-index": [{"name": "BconvQA-test1", "results": []}]}
transformers safetensors t5 text2text-generation generated_from_trainer base_model:csebuetnlp/banglat5 autotrain_compatible endpoints_compatible text-generation-inference region:us