when you decline a user, your key is removed from the buddy's lists as well