Move stat reporting, dryrun options to env vars and add tests

No more stuffing these options into data. Breaking API change, will start a 1.2.x series.

cc @rclark @willwhite