Remove item from mainstream keys when deleted