 A tiny GPT2 model for generating Hebrew text  A distilGPT2 sized model. <br> Training data was hewiki-20200701-pages-articles-multistream.xml.bz2 from https://dumps.wikimedia.org/hewiki/20200701/  <br> XML has been converted to plain text using Wikipedia Extractor http://medialab.di.unipi.it/wiki/Wikipedia_Extractor  <br> I then added <|startoftext|> and <|endoftext|> markers and deleted empty lines.  <br>  