added ina bility to only return partial data sets