Make the test plugins install throw bundler, so we don't have to install them every time we run the test (it makes the thing slow). Refactor also the bundler install task into a single one, making calls to it when necessary.

Fixes #2237
make sure the bundler task is just used once while bootstraping tests

Fixes #2237
make sure the fail fast test also have the bootstrap for tests done

Fixes #2237