Remove unused stream reference tracking.