better progress updates in between keywords, lifted limit on terms query