ALLJOYN-1988 Do not attempt to remove b2b endpoints from Virtual endpoints they were never a part of.

This reverts the previous commit "ALLJOYN-1988 B2B references are not being cleared from VirtualEndpoints."

Change-Id: I5a5c3be103bd2c9a5e5980b84d78c27024376052