Delete tags when Inbox is set deleted, don't wait until it is disowned