apache/crunch — pull request #2 by maxim432 (2014-01-28 01:05:09+00:00)
Title: Speed up multi-file source construction and reduce jobconf bloat

Currently every individual file is appended to jobconf individually with serialized schema, i.e., duplicating the schema for every file. For a couple of thousands of files this takes several minutes and bloats the jobconf triggering "Exceeded max jobconf size" exception.