
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# hubert-rinna-jdrt_RTSplit_and_SpeakerSplitModel-1217-6

This model is a fine-tuned version of [rinna/japanese-hubert-base](https://huggingface.co/rinna/japanese-hubert-base) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0182
- Wer: 0.1453
- Cer: 0.0443

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 32
- eval_batch_size: 32
- seed: 4
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 1000
- num_epochs: 50

### Training results

| Training Loss | Epoch | Step | Validation Loss | Wer    | Cer    |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
| 13.0669       | 1.0   | 60   | 10.8667         | 0.9753 | 0.9925 |
| 6.9119        | 2.0   | 120  | 6.4845          | 0.9753 | 0.9925 |
| 5.3576        | 3.0   | 180  | 5.1626          | 0.9753 | 0.9925 |
| 4.1192        | 4.0   | 240  | 3.9770          | 0.9753 | 0.9925 |
| 3.3507        | 5.0   | 300  | 3.2057          | 0.9753 | 0.9925 |
| 2.8109        | 6.0   | 360  | 2.7414          | 0.9753 | 0.9925 |
| 2.1012        | 7.0   | 420  | 1.9706          | 1.0    | 0.9203 |
| 1.5125        | 8.0   | 480  | 1.2679          | 1.0    | 0.5711 |
| 1.0409        | 9.0   | 540  | 0.9429          | 0.7785 | 0.4478 |
| 0.8529        | 10.0  | 600  | 0.7996          | 0.8080 | 0.5474 |
| 0.8376        | 11.0  | 660  | 0.7255          | 0.7916 | 0.4982 |
| 0.7394        | 12.0  | 720  | 0.7014          | 0.7800 | 0.4474 |
| 0.6891        | 13.0  | 780  | 0.6714          | 0.7740 | 0.4414 |
| 0.6422        | 14.0  | 840  | 0.6011          | 0.7579 | 0.4323 |
| 0.6397        | 15.0  | 900  | 0.5834          | 0.7400 | 0.4201 |
| 0.5564        | 16.0  | 960  | 0.5705          | 0.6560 | 0.3219 |
| 0.5534        | 17.0  | 1020 | 0.5399          | 0.6571 | 0.2865 |
| 0.9203        | 18.0  | 1080 | 0.4324          | 0.6231 | 0.2473 |
| 0.4709        | 19.0  | 1140 | 0.4063          | 0.6029 | 0.2728 |
| 0.4492        | 20.0  | 1200 | 0.4044          | 0.5742 | 0.2159 |
| 0.409         | 21.0  | 1260 | 0.3489          | 0.5110 | 0.1736 |
| 0.4966        | 22.0  | 1320 | 0.3248          | 0.4658 | 0.1637 |
| 0.3958        | 23.0  | 1380 | 0.3379          | 0.4946 | 0.1926 |
| 0.3036        | 24.0  | 1440 | 0.2552          | 0.4131 | 0.1503 |
| 0.2735        | 25.0  | 1500 | 0.2329          | 0.3713 | 0.1244 |
| 0.2477        | 26.0  | 1560 | 0.2065          | 0.3713 | 0.1323 |
| 0.2342        | 27.0  | 1620 | 0.1685          | 0.3168 | 0.1047 |
| 0.2348        | 28.0  | 1680 | 0.1582          | 0.3336 | 0.1259 |
| 0.1878        | 29.0  | 1740 | 0.1490          | 0.3086 | 0.1093 |
| 0.1706        | 30.0  | 1800 | 0.1232          | 0.2734 | 0.0861 |
| 0.1447        | 31.0  | 1860 | 0.1028          | 0.2521 | 0.0787 |
| 0.182         | 32.0  | 1920 | 0.1094          | 0.2548 | 0.0792 |
| 0.1307        | 33.0  | 1980 | 0.0817          | 0.2208 | 0.0683 |
| 0.1213        | 34.0  | 2040 | 0.1181          | 0.2424 | 0.0838 |
| 0.1673        | 35.0  | 2100 | 0.0717          | 0.2073 | 0.0672 |
| 0.0887        | 36.0  | 2160 | 0.0588          | 0.1905 | 0.0599 |
| 0.094         | 37.0  | 2220 | 0.0556          | 0.1886 | 0.0588 |
| 0.0875        | 38.0  | 2280 | 0.0461          | 0.1801 | 0.0548 |
| 0.0853        | 39.0  | 2340 | 0.0444          | 0.1804 | 0.0557 |
| 0.1212        | 40.0  | 2400 | 0.0393          | 0.1696 | 0.0538 |
| 0.0606        | 41.0  | 2460 | 0.0348          | 0.1651 | 0.0539 |
| 0.0626        | 42.0  | 2520 | 0.0310          | 0.1621 | 0.0507 |
| 0.0579        | 43.0  | 2580 | 0.0272          | 0.1569 | 0.0491 |
| 0.0629        | 44.0  | 2640 | 0.0268          | 0.1569 | 0.0487 |
| 0.0865        | 45.0  | 2700 | 0.0250          | 0.1517 | 0.0463 |
| 0.0531        | 46.0  | 2760 | 0.0222          | 0.1502 | 0.0459 |
| 0.0519        | 47.0  | 2820 | 0.0207          | 0.1505 | 0.0459 |
| 0.0462        | 48.0  | 2880 | 0.0195          | 0.1494 | 0.0456 |
| 0.0522        | 49.0  | 2940 | 0.0184          | 0.1461 | 0.0446 |
| 0.0509        | 50.0  | 3000 | 0.0182          | 0.1453 | 0.0443 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.14.6
- Tokenizers 0.15.0

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["wer"], "base_model": "rinna/japanese-hubert-base", "model-index": [{"name": "hubert-rinna-jdrt_RTSplit_and_SpeakerSplitModel-1217-6", "results": []}]}
transformers safetensors hubert automatic-speech-recognition generated_from_trainer base_model:rinna/japanese-hubert-base license:apache-2.0 endpoints_compatible region:us