Redirect us back after removing an app