Seperate configure from apply and add jenkins-cli gem.