Remove runtime dependency on 'glob' so we have no runtime deps

- Clean up .npmignore a bit more
Bump version to 2.0.4 now that I think npm files are sorted