Remove sender references when they no longer are needed.