Estimation of a Stationary Markov Chain
This article addresses the issue of empirical Bayes estimation procedures for the transition probability matrix of a single stationary Markov chain. The distribution of the frequency count matrix is obtained by relying heavily on the Whittle distributions and on the natural conjugate priors. Thence empirical Bayes estimates are obtained, and the limiting distribution is derived