Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions
Review Request #10143 - Created March 26, 2013 and updated
HdfsExportPartitioner is not always respecting maximal number of partitions. Modified partition logic.
Before using this patch, for simulating the failure in base code. In TestHdfsExtract.java, change NUMBER_OF_ROWS_PER_FILE = 1. Then try running particular test case given in this patch. Where returning partitions size is greater than required. Fix will create partitions less than or equal to required. Fixed.
|I'm concerned about losing precision when converting long to double for really big values, so I would prefer to avoid ...||Jarek Cecho||March 31, 2013, 3:28 a.m.||Open|