Correctly delete an app. Fixes #63