Maybe try uninstalling gems *before* removing rubygems