error rainchecks feature

Error Rainchecks feature. @AaronThornton00? @s01us? @rdbartlett? @jonlemmon? @robguthrie? Would someone mind taking a look? A whole lot of rebasing and squashing has taken place so here's hoping there are no major issues.