[JBTM-1453] Better control over when regression checks are enabled

!BLACKTIE !MAIN !QA_JTA !QA_JTS_JACORB !XTS