Add executable in path checking

Tested on OS X only thus far