Make sure directories get ignored too