Before revision:  We formulate the problem using Markov Decision Processes .
After revision:  We consider a random walk model for the asset price, and formulate the market maker's optimization problem using Markov Decision Processes .