Revert "Use gem_dir instead of duplicating it"

This causes SystemStackError on bundler.

This reverts commit 3ea0cef679931dbb69bb13aa284400468ec650a8.