
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec-jdrt-RTSplit_and_SpeakerSplitModel-1215-1

This model is a fine-tuned version of [jonatasgrosman/wav2vec2-large-xlsr-53-japanese](https://huggingface.co/jonatasgrosman/wav2vec2-large-xlsr-53-japanese) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0035
- Wer: 0.1967
- Cer: 0.1430

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 4
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 1000
- num_epochs: 40

### Training results

| Training Loss | Epoch | Step | Validation Loss | Wer    | Cer    |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
| 15.1674       | 1.0   | 60   | 13.7164         | 1.0    | 1.5459 |
| 4.5623        | 2.0   | 120  | 3.7033          | 0.9922 | 0.9959 |
| 2.5341        | 3.0   | 180  | 2.1577          | 1.0    | 0.8707 |
| 1.5829        | 4.0   | 240  | 1.3534          | 1.0    | 0.7459 |
| 1.1144        | 5.0   | 300  | 0.9385          | 0.8336 | 0.6091 |
| 0.8766        | 6.0   | 360  | 0.7398          | 0.8210 | 0.6348 |
| 0.7132        | 7.0   | 420  | 0.5757          | 0.7125 | 0.4770 |
| 0.5659        | 8.0   | 480  | 0.4271          | 0.5884 | 0.4086 |
| 0.4847        | 9.0   | 540  | 0.3443          | 0.5287 | 0.3404 |
| 0.4295        | 10.0  | 600  | 0.2953          | 0.4424 | 0.2642 |
| 0.3607        | 11.0  | 660  | 0.2297          | 0.3894 | 0.2373 |
| 0.3581        | 12.0  | 720  | 0.1833          | 0.3535 | 0.1922 |
| 0.3465        | 13.0  | 780  | 0.1434          | 0.3142 | 0.1875 |
| 0.2411        | 14.0  | 840  | 0.1039          | 0.2842 | 0.1993 |
| 0.1836        | 15.0  | 900  | 0.0778          | 0.2786 | 0.1611 |
| 0.197         | 16.0  | 960  | 0.0603          | 0.2460 | 0.1519 |
| 0.1879        | 17.0  | 1020 | 0.0426          | 0.2286 | 0.2137 |
| 0.1332        | 18.0  | 1080 | 0.0349          | 0.2223 | 0.1646 |
| 0.1004        | 19.0  | 1140 | 0.0260          | 0.2116 | 0.1939 |
| 0.1277        | 20.0  | 1200 | 0.0218          | 0.2219 | 0.1506 |
| 0.1185        | 21.0  | 1260 | 0.0178          | 0.2027 | 0.1461 |
| 0.091         | 22.0  | 1320 | 0.0150          | 0.2145 | 0.1569 |
| 0.094         | 23.0  | 1380 | 0.0126          | 0.2186 | 0.2046 |
| 0.0572        | 24.0  | 1440 | 0.0100          | 0.2019 | 0.1703 |
| 0.0883        | 25.0  | 1500 | 0.0086          | 0.2223 | 0.1695 |
| 0.0926        | 26.0  | 1560 | 0.0072          | 0.2134 | 0.1747 |
| 0.086         | 27.0  | 1620 | 0.0069          | 0.1945 | 0.1488 |
| 0.0527        | 28.0  | 1680 | 0.0068          | 0.1882 | 0.1364 |
| 0.0529        | 29.0  | 1740 | 0.0050          | 0.1882 | 0.1502 |
| 0.0718        | 30.0  | 1800 | 0.0052          | 0.1930 | 0.1679 |
| 0.0787        | 31.0  | 1860 | 0.0044          | 0.1916 | 0.1776 |
| 0.0484        | 32.0  | 1920 | 0.0045          | 0.1878 | 0.1498 |
| 0.0649        | 33.0  | 1980 | 0.0049          | 0.1886 | 0.1465 |
| 0.0609        | 34.0  | 2040 | 0.0043          | 0.1971 | 0.1447 |
| 0.0527        | 35.0  | 2100 | 0.0036          | 0.1997 | 0.1545 |
| 0.061         | 36.0  | 2160 | 0.0037          | 0.2027 | 0.1566 |
| 0.0413        | 37.0  | 2220 | 0.0036          | 0.1964 | 0.1502 |
| 0.0727        | 38.0  | 2280 | 0.0036          | 0.1971 | 0.1481 |
| 0.0446        | 39.0  | 2340 | 0.0035          | 0.1964 | 0.1464 |
| 0.0706        | 40.0  | 2400 | 0.0035          | 0.1967 | 0.1430 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.14.6
- Tokenizers 0.15.0

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["wer"], "base_model": "jonatasgrosman/wav2vec2-large-xlsr-53-japanese", "model-index": [{"name": "wav2vec-jdrt-RTSplit_and_SpeakerSplitModel-1215-1", "results": []}]}
transformers safetensors wav2vec2 automatic-speech-recognition generated_from_trainer base_model:jonatasgrosman/wav2vec2-large-xlsr-53-japanese license:apache-2.0 endpoints_compatible region:us