Make averager.clear() only clear the stuff we dont want to persist