Remove the now ignored directory "ghost"