Some properties of Renyi entropy and Renyi entropy rate
In this paper, we define the conditional Renyi entropy and show that the so-called chain rule holds for the Renyi entropy. Then, we introduce a relation for the rate of Renyi entropy and use it to derive the rate of the Renyi entropy for an irreducible-aperiodic Markov chain. We also show that the bound for the Renyi entropy rate is simply the Shannon entropy rate. (C) 2009 Elsevier Inc. All rights reserved.
renyi entropy renyi entropy rate shannon entropy shannon entropy rate stationary process quasi-linear mean