jsonl.gz format from https://huggingface.co/datasets/flax-sentence-embeddings/stackexchange_xml

Each line contains a dict in the format: \
{"text": ["title", "body"], "tags": ["tag1", "tag2"]}

The following parameters have been used for filtering: \
min_title_len = 20 \
min_body_len = 20 \
max_body_len = 4096 \
min_score = 0  

If a stackexchange contained less than 10k questions (after filtering), it is written to the `small_stackexchanges.jsonl.gz` file.

This is a dump of the files from https://archive.org/details/stackexchange

downloaded via torrent on 2021-07-01.

Publication date 2021-06-07  \
Usage Attribution-ShareAlike 4.0 International Creative Commons License by sa  \


Please see the license information at: https://archive.org/details/stackexchange



## Examples (lines) per file:

stackoverflow.com-Posts.jsonl.gz: 18,562,443\
math.stackexchange.com.jsonl.gz: 1,338,443\
small_stackexchanges.jsonl.gz: 448,146\
superuser.com.jsonl.gz: 435,463\
askubuntu.com.jsonl.gz: 347,925\
serverfault.com.jsonl.gz: 270,904\
tex.stackexchange.com.jsonl.gz: 202,954\
unix.stackexchange.com.jsonl.gz: 185,997\
stats.stackexchange.com.jsonl.gz: 173,466\
physics.stackexchange.com.jsonl.gz: 173,307\
electronics.stackexchange.com.jsonl.gz: 143,582\
gis.stackexchange.com.jsonl.gz: 131,000\
mathoverflow.net.jsonl.gz: 120,851\
apple.stackexchange.com.jsonl.gz: 110,622\
english.stackexchange.com.jsonl.gz: 109,522\
salesforce.stackexchange.com.jsonl.gz: 105,260\
wordpress.stackexchange.com.jsonl.gz: 100,474\
magento.stackexchange.com.jsonl.gz: 99991\
sharepoint.stackexchange.com.jsonl.gz: 94011\
gaming.stackexchange.com.jsonl.gz: 88912\
meta.stackexchange.com.jsonl.gz: 83510\
ell.stackexchange.com.jsonl.gz: 83271\
dba.stackexchange.com.jsonl.gz: 81871\
blender.stackexchange.com.jsonl.gz: 80766\
drupal.stackexchange.com.jsonl.gz: 79717\
mathematica.stackexchange.com.jsonl.gz: 73131\
scifi.stackexchange.com.jsonl.gz: 61528\
diy.stackexchange.com.jsonl.gz: 60083\
security.stackexchange.com.jsonl.gz: 58000\
softwareengineering.stackexchange.com.jsonl.gz: 53942\
android.stackexchange.com.jsonl.gz: 51608\
gamedev.stackexchange.com.jsonl.gz: 46485\
codereview.stackexchange.com.jsonl.gz: 45765\
rpg.stackexchange.com.jsonl.gz: 42303\
travel.stackexchange.com.jsonl.gz: 41227\
cs.stackexchange.com.jsonl.gz: 38314\
meta.stackoverflow.com.jsonl.gz: 36456\
webmasters.stackexchange.com.jsonl.gz: 34559\
chemistry.stackexchange.com.jsonl.gz: 34506\
academia.stackexchange.com.jsonl.gz: 34331\
ethereum.stackexchange.com.jsonl.gz: 32760\
judaism.stackexchange.com.jsonl.gz: 32028\
money.stackexchange.com.jsonl.gz: 32021\
raspberrypi.stackexchange.com.jsonl.gz: 30625\
graphicdesign.stackexchange.com.jsonl.gz: 30233\
webapps.stackexchange.com.jsonl.gz: 29697\
ux.stackexchange.com.jsonl.gz: 29403\
datascience.stackexchange.com.jsonl.gz: 27397\
worldbuilding.stackexchange.com.jsonl.gz: 26763\
bitcoin.stackexchange.com.jsonl.gz: 25374\
biology.stackexchange.com.jsonl.gz: 24447\
workplace.stackexchange.com.jsonl.gz: 24189\
photo.stackexchange.com.jsonl.gz: 23753\
cooking.stackexchange.com.jsonl.gz: 23705\
crypto.stackexchange.com.jsonl.gz: 23231\
mechanics.stackexchange.com.jsonl.gz: 22868\
japanese.stackexchange.com.jsonl.gz: 22056\
dsp.stackexchange.com.jsonl.gz: 21252\
emacs.stackexchange.com.jsonl.gz: 21055\
music.stackexchange.com.jsonl.gz: 20636\
movies.stackexchange.com.jsonl.gz: 20181\
softwarerecs.stackexchange.com.jsonl.gz: 20142\
aviation.stackexchange.com.jsonl.gz: 20139\
arduino.stackexchange.com.jsonl.gz: 19553\
law.stackexchange.com.jsonl.gz: 17941\
puzzling.stackexchange.com.jsonl.gz: 17851\
quant.stackexchange.com.jsonl.gz: 17261\
rus.stackexchange.com.jsonl.gz: 16871\
bicycles.stackexchange.com.jsonl.gz: 16353\
space.stackexchange.com.jsonl.gz: 15142\
gardening.stackexchange.com.jsonl.gz: 15136\
philosophy.stackexchange.com.jsonl.gz: 14829\
german.stackexchange.com.jsonl.gz: 13950\
networkengineering.stackexchange.com.jsonl.gz: 13454\
hinduism.stackexchange.com.jsonl.gz: 13450\
craftcms.stackexchange.com.jsonl.gz: 12574\
civicrm.stackexchange.com.jsonl.gz: 12543\
boardgames.stackexchange.com.jsonl.gz: 12149\
christianity.stackexchange.com.jsonl.gz: 12108\
history.stackexchange.com.jsonl.gz: 12021\
politics.stackexchange.com.jsonl.gz: 11894\
expressionengine.stackexchange.com.jsonl.gz: 11866\
islam.stackexchange.com.jsonl.gz: 11853\
anime.stackexchange.com.jsonl.gz: 11444\
economics.stackexchange.com.jsonl.gz: 11115\
french.stackexchange.com.jsonl.gz: 10794\
engineering.stackexchange.com.jsonl.gz: 10753\
cstheory.stackexchange.com.jsonl.gz: 10642\
vi.stackexchange.com.jsonl.gz: 10551\
astronomy.stackexchange.com.jsonl.gz: 10462\
writers.stackexchange.com.jsonl.gz: 10157\
skeptics.stackexchange.com.jsonl.gz: 10009\
**Total: 25,333,327**

region:us
{}
TAGS
#region-us 

URL format from URL

Each line contains a dict in the format: \
{"text": ["title", "body"], "tags": ["tag1", "tag2"]}

The following parameters have been used for filtering: \
min_title_len = 20 \
min_body_len = 20 \
max_body_len = 4096 \
min_score = 0  

If a stackexchange contained less than 10k questions (after filtering), it is written to the 'small_stackexchanges.URL' file.

This is a dump of the files from URL

downloaded via torrent on 2021-07-01.

Publication date 2021-06-07  \
Usage Attribution-ShareAlike 4.0 International Creative Commons License by sa  \


Please see the license information at: URL



## Examples (lines) per file:

URL: 18,562,443\
URL: 1,338,443\
small_stackexchanges.URL: 448,146\
URL: 435,463\
URL: 347,925\
URL: 270,904\
URL: 202,954\
URL: 185,997\
URL: 173,466\
URL: 173,307\
URL: 143,582\
URL: 131,000\
URL: 120,851\
URL: 110,622\
URL: 109,522\
URL: 105,260\
URL: 100,474\
URL: 99991\
URL: 94011\
URL: 88912\
URL: 83510\
URL: 83271\
URL: 81871\
URL: 80766\
URL: 79717\
URL: 73131\
URL: 61528\
URL: 60083\
URL: 58000\
URL: 53942\
URL: 51608\
URL: 46485\
URL: 45765\
URL: 42303\
URL: 41227\
URL: 38314\
URL: 36456\
URL: 34559\
URL: 34506\
URL: 34331\
URL: 32760\
URL: 32028\
URL: 32021\
URL: 30625\
URL: 30233\
URL: 29697\
URL: 29403\
URL: 27397\
URL: 26763\
URL: 25374\
URL: 24447\
URL: 24189\
URL: 23753\
URL: 23705\
URL: 23231\
URL: 22868\
URL: 22056\
URL: 21252\
URL: 21055\
URL: 20636\
URL: 20181\
URL: 20142\
URL: 20139\
URL: 19553\
URL: 17941\
URL: 17851\
URL: 17261\
URL: 16871\
URL: 16353\
URL: 15142\
URL: 15136\
URL: 14829\
URL: 13950\
URL: 13454\
URL: 13450\
URL: 12574\
URL: 12543\
URL: 12149\
URL: 12108\
URL: 12021\
URL: 11894\
URL: 11866\
URL: 11853\
URL: 11444\
URL: 11115\
URL: 10794\
URL: 10753\
URL: 10642\
URL: 10551\
URL: 10462\
URL: 10157\
URL: 10009\
Total: 25,333,327

## Examples (lines) per file:

URL: 18,562,443\
URL: 1,338,443\
small_stackexchanges.URL: 448,146\
URL: 435,463\
URL: 347,925\
URL: 270,904\
URL: 202,954\
URL: 185,997\
URL: 173,466\
URL: 173,307\
URL: 143,582\
URL: 131,000\
URL: 120,851\
URL: 110,622\
URL: 109,522\
URL: 105,260\
URL: 100,474\
URL: 99991\
URL: 94011\
URL: 88912\
URL: 83510\
URL: 83271\
URL: 81871\
URL: 80766\
URL: 79717\
URL: 73131\
URL: 61528\
URL: 60083\
URL: 58000\
URL: 53942\
URL: 51608\
URL: 46485\
URL: 45765\
URL: 42303\
URL: 41227\
URL: 38314\
URL: 36456\
URL: 34559\
URL: 34506\
URL: 34331\
URL: 32760\
URL: 32028\
URL: 32021\
URL: 30625\
URL: 30233\
URL: 29697\
URL: 29403\
URL: 27397\
URL: 26763\
URL: 25374\
URL: 24447\
URL: 24189\
URL: 23753\
URL: 23705\
URL: 23231\
URL: 22868\
URL: 22056\
URL: 21252\
URL: 21055\
URL: 20636\
URL: 20181\
URL: 20142\
URL: 20139\
URL: 19553\
URL: 17941\
URL: 17851\
URL: 17261\
URL: 16871\
URL: 16353\
URL: 15142\
URL: 15136\
URL: 14829\
URL: 13950\
URL: 13454\
URL: 13450\
URL: 12574\
URL: 12543\
URL: 12149\
URL: 12108\
URL: 12021\
URL: 11894\
URL: 11866\
URL: 11853\
URL: 11444\
URL: 11115\
URL: 10794\
URL: 10753\
URL: 10642\
URL: 10551\
URL: 10462\
URL: 10157\
URL: 10009\
Total: 25,333,327
TAGS
#region-us 
 ## Examples (lines) per file:

URL: 18,562,443\
URL: 1,338,443\
small_stackexchanges.URL: 448,146\
URL: 435,463\
URL: 347,925\
URL: 270,904\
URL: 202,954\
URL: 185,997\
URL: 173,466\
URL: 173,307\
URL: 143,582\
URL: 131,000\
URL: 120,851\
URL: 110,622\
URL: 109,522\
URL: 105,260\
URL: 100,474\
URL: 99991\
URL: 94011\
URL: 88912\
URL: 83510\
URL: 83271\
URL: 81871\
URL: 80766\
URL: 79717\
URL: 73131\
URL: 61528\
URL: 60083\
URL: 58000\
URL: 53942\
URL: 51608\
URL: 46485\
URL: 45765\
URL: 42303\
URL: 41227\
URL: 38314\
URL: 36456\
URL: 34559\
URL: 34506\
URL: 34331\
URL: 32760\
URL: 32028\
URL: 32021\
URL: 30625\
URL: 30233\
URL: 29697\
URL: 29403\
URL: 27397\
URL: 26763\
URL: 25374\
URL: 24447\
URL: 24189\
URL: 23753\
URL: 23705\
URL: 23231\
URL: 22868\
URL: 22056\
URL: 21252\
URL: 21055\
URL: 20636\
URL: 20181\
URL: 20142\
URL: 20139\
URL: 19553\
URL: 17941\
URL: 17851\
URL: 17261\
URL: 16871\
URL: 16353\
URL: 15142\
URL: 15136\
URL: 14829\
URL: 13950\
URL: 13454\
URL: 13450\
URL: 12574\
URL: 12543\
URL: 12149\
URL: 12108\
URL: 12021\
URL: 11894\
URL: 11866\
URL: 11853\
URL: 11444\
URL: 11115\
URL: 10794\
URL: 10753\
URL: 10642\
URL: 10551\
URL: 10462\
URL: 10157\
URL: 10009\
Total: 25,333,327
passage: TAGS
#region-us 
