Remove the now ignored directory data