Only set stopped when we really stopped