update tests to be compatiable with full data set