Remove now-ignored directory