Fail if an application can't be started, closes #869