general coding of 7/29, includes more work to get offsets correct, and adding AUC estimates to machine learning