Review Board 1.7.22


SQOOP-428: Support compression for Avro import

Review Request #3600 - Created Jan. 24, 2012 and updated

Lars Francke
SQOOP-428
Reviewers
Sqoop
sqoop-trunk
This basically only ports all the code from Avro's (1.5.4) AvroOutputFormat to the new MR API.

I've changed the test to extract the common functionality into a helper method because they are the same apart from the two command line arguments.

I could have deleted AvroJob completely but as I was told last time that binary compatibility needs to be maintained I left it in. It's not needed anymore as all necessary functionality can be gotten from Avro's own version of that file as far as I can tell. So if it's okay to delete that redundant file (two actually, cloudera and apache package) let me know and I'll provide a new patch.
All tests pass for hadoopversion=20 but TestColumnTypes fails for me on 23. I can't see how that's related though.
Review request changed
Updated (Feb. 2, 2012, 2:31 p.m.)
Updated to remove any mention of Snappy (which isn't available on Hadoop 1.0.0)
Ship it!
Posted (Feb. 4, 2012, 9:33 p.m.)
Thank you for your time spent on this issue sir.