Remove the now ignored directory "stuff"