Ignore non-YAML files when loading contact files

On @ramirezg's behalf, filing a PR for his fix for #160.