# Dataset Card for "oig_small_chip2_noncode"

From LAION's Open Instruction Generalist (OIG) dataset, we provide a subset whose samples are not code-related. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:

Prompts: 150453

Tokens: 11522004 using the EleutherAI/gpt-neox-20b tokenizer (counting instruction+input+output)
region:us
{"dataset_info": {"features": [{"name": "instruction", "dtype": "string"}, {"name": "output", "dtype": "string"}, {"name": "input", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 54969398.0, "num_examples": 150453}], "download_size": 34598598, "dataset_size": 54969398.0}}
TAGS
#region-us 

# Dataset Card for "oig_small_chip2_noncode"

From LAION's Open Instruction Generalist (OIG) dataset, we provide a subset whose samples are not code-related. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:

Prompts: 150453

Tokens: 11522004 using the EleutherAI/gpt-neox-20b tokenizer (counting instruction+input+output)
# Dataset Card for "oig_small_chip2_noncode"

From LAION's Open Instruction Generalist (OIG) dataset, we provide a subset whose samples are not code-related. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:

Prompts: 150453

Tokens: 11522004 using the EleutherAI/gpt-neox-20b tokenizer (counting instruction+input+output)
TAGS
#region-us 
 # Dataset Card for "oig_small_chip2_noncode"

From LAION's Open Instruction Generalist (OIG) dataset, we provide a subset whose samples are not code-related. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:

Prompts: 150453

Tokens: 11522004 using the EleutherAI/gpt-neox-20b tokenizer (counting instruction+input+output)