The max Q for terminal states is what ever it's own reward is.