Undoing the setting of the gem binary as that didn't fix the problem.