- B. Raj, E. Whittaker. 2001. Quantization-basedLanguageModel Compression. Abstract: This paper describes two techniques for reducing the sizeof statistical back-off gramlanguagemodelsin computermemory. Languagemodelcompresionis achieved throughacombinationof quantizing languagemodelprobabilitiesandback-off weights andthepruning of parametersthataredeterminedto beunnecessary afterquantization. Therecognition performanceof theoriginal andcompressedlanguagemodelsis evaluated acrossthreedifferent languagemodelsandtwo different recognition tasks. The results showthatthelanguagemodelscanbecompresedby upto 60%of theiroriginal sizewith no significantlossin recognition performance.Moreover, thetechniquesthat aredescribed provide a principled methodwith which to compres languagemodels furtherwhile minimising degradationin recognition performance.
