Review Board 1.7.22


HIVE-2035 Use block level merge on rcfile if intermediate merge is needed

Review Request #935 - Created June 17, 2011 and submitted

Franklin Hu
HIVE-2035
Reviewers
hive
hive
For a table stored as RCFile, intermediate results are sometimes merged if those files are below a certain threshold. For RCFiles, we can do a block level merge that does not deserialize the blocks and is more efficient. This patch leverages the existing code used to merge for ALTER TABLE ... CONCATENATE.

 
Review request changed
Updated (June 23, 2011, 6:56 p.m.)
Add max and min split size configs to unit tests