We need to check *every* directory component, not just the lowest one.

skip_ignored_dirs() is weird in that it takes just a single directory
name, not a full path (so it will be useless for our skip-files regexp
stuff one day).  Ah well.

Auditors: dylan

Test Plan:
Dylan will test!