Remove the added paths from GEM_PATH instead of unsetting it (issue #107).