remove .rvmrc from gemspec too

to not break the Gem build.