Only ignore a file or directory if it exists.

Fixes #10 

Turns out if you have `exclude`'d a non-existent file or directory, then shit freaked out.