Defer delete of peer till its reference is removed from RTGroupManager

Change-Id: I0bcfb3be20a3b01ae895badd46285fee4ee6affa
Merge "Defer delete of peer till its reference is removed from RTGroupManager"