Optimize by default and use flags to disable

For #322, if we still want to do it this way, of course.