jghoman/haivvreo — Issue #12: add support for merging of small files
Author: aripollak
Created: 2012-01-05 22:38:32+00:00
State: open

If I have a source table and a destination table, both in a format natively supported by Hive (let's say the source is a TextFile and the destination is an RCFile), with hundreds of small (couple of megs) files located in the source, Hive will automatically merge the small files when inserting into the destination. If the destination uses Haivvreo storage, this automatic merge does not take place.