webrtcendpoint: Make proper use of referenciable object management

Change-Id: I181f3902b2d8f80409a216c9c46f34e0a70aebc9