Check that directory is an app. Fixes #74