Check that app path exists