thousands of products crawled and moving to SQL to store