fixed some issues with the index
implemented returning only new data