Remove the local AV stream from ourselves when handing it off to a new call or we'll close it when we hang up.