Respect gem_source option if specified