Only ignore hidden files within source dirs

Don't ignore whole source dir if a path component is hidden. This should
fix the Lucy build for CPAN smokers which typically have Clownfish
somewhere under a .cpan directory.

Should fix CLOWNFISH-8.