generate data matrix, needs imputation or interpolation