Make this similar to apt's so that we can actually test multiple copies

of ruby/puppet properly.