tested on full size dataset