Question: do critical points have to be in the domain?
Answer: This is an important, and often overlooked, point. What this is really saying is that all critical points must be in the domain of the function. If a point is not in the domain of the function then it is not a critical point.