Slight tweak to directory name exclusion.

This allows the build area to have source as part of its name (though not -sources), which mine does.
I could rename my build area, of course, but I don't see any downside to a slightly more restrictive test.