needs pagination when used for the index.  Also batch insert on the index.