Do not clear GEM_HOME if there is any git-sourced gem in Gemfile.

Fixes #352.