Kill the friendManager on disconnect