Remove peer reference from other peers routing tables, if peer is destroyed.