check only the basename of a file by default
refactor requirements loading

move file line processing to a separate function and add more file
patterns so we are more restrictive with the files that are loaded by
default
filter only directories for discovery

ignore any extra files or symlinks that might appear in the repository
structure