Update the cached stats if the state changed

Fixes the fuzzy issues