Actually remove pages when we say we will.