Actually remove ignored files