Introduce regtest for JENKINS-16630