Memoize (almost) all the things related to visualizations