
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec-jdrt-training_rev-F1_M1_4800_and_clean-F2_M2_4800-2

This model is a fine-tuned version of [rinna/japanese-hubert-base](https://huggingface.co/rinna/japanese-hubert-base) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0008
- Wer: 0.1882
- Cer: 0.1056

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 32
- eval_batch_size: 32
- seed: 4
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 1000
- num_epochs: 25

### Training results

| Training Loss | Epoch | Step | Validation Loss | Wer    | Cer    |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
| 3.9656        | 1.0   | 240  | 3.7462          | 0.9868 | 0.9894 |
| 1.4966        | 2.0   | 480  | 1.3770          | 1.0    | 0.6450 |
| 0.853         | 3.0   | 720  | 0.7171          | 0.8415 | 0.5379 |
| 0.6527        | 4.0   | 960  | 0.6107          | 0.8185 | 0.4716 |
| 0.582         | 5.0   | 1200 | 0.5180          | 0.7849 | 0.4622 |
| 0.4508        | 6.0   | 1440 | 0.3611          | 0.5979 | 0.2865 |
| 0.3043        | 7.0   | 1680 | 0.2049          | 0.4405 | 0.2730 |
| 0.2337        | 8.0   | 1920 | 0.1434          | 0.4071 | 0.2889 |
| 0.2228        | 9.0   | 2160 | 0.1021          | 0.3289 | 0.1687 |
| 0.1174        | 10.0  | 2400 | 0.0642          | 0.2516 | 0.1300 |
| 0.1429        | 11.0  | 2640 | 0.0679          | 0.2518 | 0.0994 |
| 0.0817        | 12.0  | 2880 | 0.0290          | 0.2185 | 0.1239 |
| 0.0826        | 13.0  | 3120 | 0.0169          | 0.2049 | 0.1127 |
| 0.0532        | 14.0  | 3360 | 0.0129          | 0.1973 | 0.0967 |
| 0.0349        | 15.0  | 3600 | 0.0084          | 0.1886 | 0.0788 |
| 0.0402        | 16.0  | 3840 | 0.0065          | 0.1884 | 0.0793 |
| 0.0335        | 17.0  | 4080 | 0.0042          | 0.1847 | 0.0790 |
| 0.0298        | 18.0  | 4320 | 0.0038          | 0.1911 | 0.0998 |
| 0.0179        | 19.0  | 4560 | 0.0029          | 0.1938 | 0.1211 |
| 0.0305        | 20.0  | 4800 | 0.0025          | 0.1891 | 0.1123 |
| 0.0289        | 21.0  | 5040 | 0.0024          | 0.2006 | 0.1261 |
| 0.0166        | 22.0  | 5280 | 0.0017          | 0.1935 | 0.1148 |
| 0.0301        | 23.0  | 5520 | 0.0011          | 0.1931 | 0.1124 |
| 0.0193        | 24.0  | 5760 | 0.0009          | 0.1874 | 0.1025 |
| 0.0295        | 25.0  | 6000 | 0.0008          | 0.1882 | 0.1056 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.14.6
- Tokenizers 0.15.0

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["wer"], "base_model": "rinna/japanese-hubert-base", "model-index": [{"name": "wav2vec-jdrt-training_rev-F1_M1_4800_and_clean-F2_M2_4800-2", "results": []}]}
transformers safetensors wav2vec2 automatic-speech-recognition generated_from_trainer base_model:rinna/japanese-hubert-base license:apache-2.0 endpoints_compatible region:us