Don't engage watcher unless watching fs

Is this reasonable? I only tested with `npm test`.