Speed up fits by caching the hole list - no need to traverse the full list