
# Dataset Card for "open-instruct-v1"

Open Instruct V1 is an amalgamation of different datasets which are cleaned and then collated into a singular format for training.
Uses Stability AI's System Prompt.
```
### System: StableLM Tuned (Alpha version)
- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.
- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
- StableLM is more than just an information source, StableLM is also able to write poetry, short stories, and make jokes.
- StableLM will refuse to participate in anything that could harm a human.
```

## Dataset Breakdown

| Dataset        | Amount of Samples |
|----------------|-------------------|
| [Alpaca](https://github.com/tatsu-lab/stanford_alpaca) |         51759 |
| [Self Instruct](https://github.com/yizhongw/self-instruct)  |  82599 |
| [GPT-4 Instruct](https://github.com/teknium1/GPTeacher) |  18194 |
| [Code Alpaca](https://huggingface.co/datasets/HuggingFaceH4/CodeAlpaca_20K) | 18019 |
| [Dolly](https://huggingface.co/datasets/HuggingFaceH4/databricks_dolly_15k) | 15015 |
| [Synthetic](https://huggingface.co/datasets/Dahoas/synthetic-instruct-gptj-pairwise)      |  33143 |
| [Roleplay](https://github.com/teknium1/GPTeacher)       |   3146 |
| [asss](https://huggingface.co/datasets/HuggingFaceH4/asss) | 448 |
| [instruction-dataset](https://huggingface.co/datasets/HuggingFaceH4/instruction-dataset) | 327 |
| [Human assistant deduped](https://huggingface.co/datasets/Isotonic/human_assistant_conversation_deduped) | 209350
| Total          | 432000            |
task_categories:text-generation task_categories:conversational size_categories:100K<n<1M language:en region:us
{"language": ["en"], "size_categories": ["100K<n<1M"], "task_categories": ["text-generation", "conversational"], "dataset_info": {"features": [{"name": "instruction", "dtype": "string"}, {"name": "input", "dtype": "string"}, {"name": "output", "dtype": "string"}, {"name": "text", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 693502500.8465096, "num_examples": 399050}, {"name": "test", "num_bytes": 173376494.1534904, "num_examples": 99763}], "download_size": 369952246, "dataset_size": 866878995.0}}
TAGS
#task_categories-text-generation #task_categories-conversational #size_categories-100K<n<1M #language-English #region-us 

Dataset Card for "open-instruct-v1"
===================================


Open Instruct V1 is an amalgamation of different datasets which are cleaned and then collated into a singular format for training.
Uses Stability AI's System Prompt.


Dataset Breakdown
-----------------




TAGS
#task_categories-text-generation #task_categories-conversational #size_categories-100K<n<1M #language-English #region-us 

passage: TAGS
#task_categories-text-generation #task_categories-conversational #size_categories-100K<n<1M #language-English #region-us 
