Attempt to install all gems in CI

I forget how this broke before