lots of progress on massaging data into a by-date thing