Allow jenkins to skip failover tests

This is necessary to test the Cloudflare config