Remove the now ignored input directory