Preserve original gemspec path

In order to keep the gemspec paths for use in different paths, the path
is preserved in it's original form.

This change addresses #2458.