Question: Is the assumption that natural language is stationary and ergodic valid?
Answer: It is not completely valid for natural languages because of diversity of language - this is called smoothing requirement.