Need to mark the application delete as failed if it's unable to remove the app directory. Hopefully this is only needed for tests