Title: Markov Chain Analysis for Large-Scale Grid Systems