Give user more context about what they are doing when adding a subpage.

From #5422.