HW5 1st-order horizontal and vertical markovization.