back to Model8, not striving for perfection, scaling up slow and measuredly, using data.table should be a big help