# Dataset Card for "minipile_filtered_5percent"

from [minipile](https://huggingface.co/datasets/JeanKaddour/minipile)

I filtered by length and langID (fastext threshold 0.915) for a 5% subset of 50k rows

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
region:us
{"dataset_info": {"features": [{"name": "text", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 293297348.6066, "num_examples": 49660}], "download_size": 121567497, "dataset_size": 293297348.6066}}
TAGS
#region-us 

# Dataset Card for "minipile_filtered_5percent"

from minipile

I filtered by length and langID (fastext threshold 0.915) for a 5% subset of 50k rows

More Information needed
# Dataset Card for "minipile_filtered_5percent"

from minipile

I filtered by length and langID (fastext threshold 0.915) for a 5% subset of 50k rows

More Information needed
TAGS
#region-us 
 # Dataset Card for "minipile_filtered_5percent"

from minipile

I filtered by length and langID (fastext threshold 0.915) for a 5% subset of 50k rows

More Information needed