Backport autoconfirm functionality from provision branch to master branch