Test app without a config.json to check our error handling on loading apps