For different kinds of documents, you would expect different kinds of the different words, may be you'll see different correlations between words And so you could use a set of hidden units to model the distribution for each document. 