Change check to only run on manifests directory

This was picking up files in vendor/ installed by bundler