Just do hard-recalc on stream refresh. That takes care of all our needs.

Change-Id: I9a454089843d1373153988a29843b95db22ee284