don't update if ran with test flag
mode with nothing means dev