
# StackExchange Paired

This is a processed version of the [`HuggingFaceH4/stack-exchange-preferences`](https://huggingface.co/datasets/HuggingFaceH4/stack-exchange-preferences). The following steps were applied:

- Parse HTML to Markdown with `markdownify`
- Create pairs `(response_j, response_k)` where j was rated better than k
- Sample at most 10 pairs per question
- Shuffle the dataset globally

This dataset is designed to be used for preference learning. The processing notebook is in [the repository](https://huggingface.co/datasets/lvwerra/stack-exchange-paired/tree/main) as well.

task_categories:text-generation task_categories:question-answering size_categories:10M<n<100M language:en region:us
{"language": ["en"], "size_categories": ["10M<n<100M"], "task_categories": ["text-generation", "question-answering"], "pretty_name": "StackExchange Paired"}
TAGS
#task_categories-text-generation #task_categories-question-answering #size_categories-10M<n<100M #language-English #region-us 


# StackExchange Paired

This is a processed version of the 'HuggingFaceH4/stack-exchange-preferences'. The following steps were applied:

- Parse HTML to Markdown with 'markdownify'
- Create pairs '(response_j, response_k)' where j was rated better than k
- Sample at most 10 pairs per question
- Shuffle the dataset globally

This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.

# StackExchange Paired

This is a processed version of the 'HuggingFaceH4/stack-exchange-preferences'. The following steps were applied:

- Parse HTML to Markdown with 'markdownify'
- Create pairs '(response_j, response_k)' where j was rated better than k
- Sample at most 10 pairs per question
- Shuffle the dataset globally

This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.
TAGS
#task_categories-text-generation #task_categories-question-answering #size_categories-10M<n<100M #language-English #region-us 
 # StackExchange Paired

This is a processed version of the 'HuggingFaceH4/stack-exchange-preferences'. The following steps were applied:

- Parse HTML to Markdown with 'markdownify'
- Create pairs '(response_j, response_k)' where j was rated better than k
- Sample at most 10 pairs per question
- Shuffle the dataset globally

This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.