Framework for work on million document exploration