Add command line option to skip runs and all subsequent tests