rtpendpoint: Move elements to a private structure

Change-Id: Ife518e6e43acb9fceaca892eb17b310c74a139c0