Parquet/parquet-mr — pull request #131 by FelixNeutatz (2013-08-12 23:46:26+00:00)
Title: Extending Parquet to be able to use projection for multiple input files

At the moment I am experimenting to join Parquet files. But I recognized that it is not possible yet to read two Parquet files with different schemas and apply a projection for each schema. Therefore I propose a minor change of the class ReadSupport (https://github.com/Parquet/parquet-mr/blob/master/parquet-hadoop/src/main/java/parquet/hadoop/api/ReadSupport.java) in the function getSchemaForRead(). At the moment it only reads one message from the configuration variable ReadSupport.PARQUET_READ_SCHEMA. But I would suggest to introduce a delimiter like i.e. "|" to be able to store there more messages. In ReadSupport we could check then whether there is one message which fits to our current parquet input file.