Make autoreload configurable, and default it to off.