(maint) Revert "Merge pull request #232 from shrug/maint/qe-465"

This reverts commit afc957cf748f23d7fdd0564312a699dd7175c04b, reversing
changes made to 50e80b26da3bc704a9c785f1c3f225d789d4d021.

We are not really taking advantage of this, and the plugin has been disabled on at least one of the internal jenkins instances. Removing this configuration since it's no longer necessary.