
# Dataset Card for ReazonSpeech

## Dataset Description

- **Homepage:** https://research.reazon.jp/projects/ReazonSpeech
- **GitHub:** https://github.com/reazon-research/reazonspeech

## Dataset Summary

This dataset contains a diverse set of natural Japanese speech, collected
from terrestrial television streams. It contains more than 35000 hours of
audio.

Paper: [ReazonSpeech: A Free and Massive Corpus for Japanese ASR](https://research.reazon.jp/_static/reazonspeech_nlp2023.pdf)

### Disclaimer

**TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.**

## Dataset Format

Audio files are available in FLAC format, sampled at 16000 hz.
Each audio file is accompanied with a transcription.

```
{
    'name': '000/0000000000000.flac',
    'audio': {
        'path': '/path/to/000/0000000000000.flac',
        'array': array([ 0.01000000,  ...], dtype=float32),
        'sampling_rate': 16000
    },
    'transcription': '今日のニュースをお伝えします。'
}
```

We provide 5 different dataset sizes. Here is the list of available
sizes and their approximate recording hours.

| Name     | Size  | Hours       |
| -------- | ----- | ----------- |
| `tiny`   | 600MB |   8.5 hours |
| `small`  |   6GB |   100 hours |
| `medium` |  65GB |  1000 hours |
| `large`  | 330GB |  5000 hours |
| `all`    | 2.3TB | 35000 hours |

You can access this dataset through Hugging Face `datasets` library.

```
from datasets import load_dataset
ds = load_dataset("reazon-research/reazonspeech", "all", trust_remote_code=True)
```

## Access the older versions

If you want to access the older versions of ReazonSpeech corpus,
you can use the following tags.

| Name        | Size  | Hours       |
| ----------- | ----- | ----------- |
| `small-v1`  | 350MB |     5 hours |
| `medium-v1` |  22GB |   300 hours |
| `all-v1`    |   1TB | 19000 hours |

## License

[CDLA-Sharing-1.0](https://cdla.dev/sharing-1-0/)

TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.

task_categories:automatic-speech-recognition size_categories:10M<n<100M language:ja license:other region:us
{"language": ["ja"], "license": "other", "size_categories": ["10M<n<100M"], "task_categories": ["automatic-speech-recognition"], "pretty_name": "ReazonSpeech"}
TAGS
#task_categories-automatic-speech-recognition #size_categories-10M<n<100M #language-Japanese #license-other #region-us 

Dataset Card for ReazonSpeech
=============================


Dataset Description
-------------------


* Homepage: URL
* GitHub: URL


Dataset Summary
---------------


This dataset contains a diverse set of natural Japanese speech, collected
from terrestrial television streams. It contains more than 35000 hours of
audio.


Paper: ReazonSpeech: A Free and Massive Corpus for Japanese ASR


### Disclaimer


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.


Dataset Format
--------------


Audio files are available in FLAC format, sampled at 16000 hz.
Each audio file is accompanied with a transcription.


We provide 5 different dataset sizes. Here is the list of available
sizes and their approximate recording hours.


Name: 'tiny', Size: 600MB, Hours: 8.5 hours
Name: 'small', Size: 6GB, Hours: 100 hours
Name: 'medium', Size: 65GB, Hours: 1000 hours
Name: 'large', Size: 330GB, Hours: 5000 hours
Name: 'all', Size: 2.3TB, Hours: 35000 hours


You can access this dataset through Hugging Face 'datasets' library.


Access the older versions
-------------------------


If you want to access the older versions of ReazonSpeech corpus,
you can use the following tags.


Name: 'small-v1', Size: 350MB, Hours: 5 hours
Name: 'medium-v1', Size: 22GB, Hours: 300 hours
Name: 'all-v1', Size: 1TB, Hours: 19000 hours


License
-------


CDLA-Sharing-1.0


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.



### Disclaimer


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.


Dataset Format
--------------


Audio files are available in FLAC format, sampled at 16000 hz.
Each audio file is accompanied with a transcription.


We provide 5 different dataset sizes. Here is the list of available
sizes and their approximate recording hours.


Name: 'tiny', Size: 600MB, Hours: 8.5 hours
Name: 'small', Size: 6GB, Hours: 100 hours
Name: 'medium', Size: 65GB, Hours: 1000 hours
Name: 'large', Size: 330GB, Hours: 5000 hours
Name: 'all', Size: 2.3TB, Hours: 35000 hours


You can access this dataset through Hugging Face 'datasets' library.


Access the older versions
-------------------------


If you want to access the older versions of ReazonSpeech corpus,
you can use the following tags.


Name: 'small-v1', Size: 350MB, Hours: 5 hours
Name: 'medium-v1', Size: 22GB, Hours: 300 hours
Name: 'all-v1', Size: 1TB, Hours: 19000 hours


License
-------


CDLA-Sharing-1.0


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.
TAGS
#task_categories-automatic-speech-recognition #size_categories-10M<n<100M #language-Japanese #license-other #region-us 
 ### Disclaimer


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.


Dataset Format
--------------


Audio files are available in FLAC format, sampled at 16000 hz.
Each audio file is accompanied with a transcription.


We provide 5 different dataset sizes. Here is the list of available
sizes and their approximate recording hours.


Name: 'tiny', Size: 600MB, Hours: 8.5 hours
Name: 'small', Size: 6GB, Hours: 100 hours
Name: 'medium', Size: 65GB, Hours: 1000 hours
Name: 'large', Size: 330GB, Hours: 5000 hours
Name: 'all', Size: 2.3TB, Hours: 35000 hours


You can access this dataset through Hugging Face 'datasets' library.


Access the older versions
-------------------------


If you want to access the older versions of ReazonSpeech corpus,
you can use the following tags.


Name: 'small-v1', Size: 350MB, Hours: 5 hours
Name: 'medium-v1', Size: 22GB, Hours: 300 hours
Name: 'all-v1', Size: 1TB, Hours: 19000 hours


License
-------


CDLA-Sharing-1.0


TO USE THIS DATASET, YOU MUST AGREE THAT YOU WILL USE THE DATASET
SOLELY FOR THE PURPOSE OF JAPANESE COPYRIGHT ACT ARTICLE 30-4.