Cleanup cache when switching stream