Initial contents on Markov Decision Processes