A subset of [CommitPack](https://huggingface.co/datasets/bigcode/commitpack) used for pretraining [SantaCoderPack](https://huggingface.co/bigcode/santacoderpack) from the OctoPack paper. 

It focuses on data where the code before + special token + code after fits into 8192 tokens and on 6 languages. The data is in commit format (cf): `<commit_before>code_before<commit_message>commit_message<commit_after>code_after`.
region:us
{}
TAGS
#region-us 

A subset of CommitPack used for pretraining SantaCoderPack from the OctoPack paper. 

It focuses on data where the code before + special token + code after fits into 8192 tokens and on 6 languages. The data is in commit format (cf): '<commit_before>code_before<commit_message>commit_message<commit_after>code_after'.
TAGS
#region-us 

passage: TAGS
#region-us 
