Make rtp#Add and rtp#Remove respect the rtp cache

The cache was only being updated by rtp#Split.