Computational methods for exact and approximate computations of stationary distributions and entropy rates of Markov process, particularly those common in evolutionary dynamics.