This dataset was created by automatically translating part of "Anthropic/hh-rlhf" into Japanese.  
This dataset is also included in "mosaicml/dolly_hhrlhf".

The "ng_translation" flag indicates that the translation was not successful, and "1" means that the translation failed.
Therefore, for data with "1", "instruction" and "instruction_en" contain the same text.

以下の通りに読み込むことで"ng_translation"が"1"（翻訳誤り）のものを除外して使用できます。

```
pip install datasets
```
```
from datasets import Dataset, load_dataset

dataset = load_dataset("kunishou/hh-rlhf-49k-ja")
dataset.set_format(type="pandas")
df = dataset["train"][:]
df = df[df["ng_translation"]!="1"].drop(["ng_translation", "index"], axis=1).reset_index()
dataset = Dataset.from_pandas(df)
dataset
```

hh-rlhf repository  
https://github.com/anthropics/hh-rlhf

Anthropic/hh-rlhf  
https://huggingface.co/datasets/Anthropic/hh-rlhf

mosaicml/dolly_hhrlhf  
https://huggingface.co/datasets/mosaicml/dolly_hhrlhf
license:mit region:us
{"license": "mit"}
TAGS
#license-mit #region-us 

This dataset was created by automatically translating part of "Anthropic/hh-rlhf" into Japanese.  
This dataset is also included in "mosaicml/dolly_hhrlhf".

The "ng_translation" flag indicates that the translation was not successful, and "1" means that the translation failed.
Therefore, for data with "1", "instruction" and "instruction_en" contain the same text.

以下の通りに読み込むことで"ng_translation"が"1"（翻訳誤り）のものを除外して使用できます。




hh-rlhf repository  
URL

Anthropic/hh-rlhf  
URL

mosaicml/dolly_hhrlhf  
URL
TAGS
#license-mit #region-us 
