Ensure no old gems are left behind between test runs.
Run bundle clean after bundle install

Running it beforehand was resulting in a corrupted state
if it was the first time bundle install was run.
Merge pull request #3919 from edx/benpatterson/clean-up-rbenv

Ensure no old gems are left behind between test runs.