Add config option to check a few times before restarting.