Add option to respect wildignore

I left it off by default to maintain the current behavior, but personally think it should be on by default instead. For reference, not respecting `wildignore` has added in #172.