Or in general, download it to a temporary place in the build_path (instead of gem_dir/cache) - that way you have a directory with one file.

The python package does this as well: https://github.com/jordansissel/fpm/blob/master/lib/fpm/package/python.rb#L128-L134