Robust starting / stopping app