Review Board 1.7.22

SQOOP-428: Support compression for Avro import

Review Request #3600 - Created Jan. 24, 2012 and updated

Lars Francke
This basically only ports all the code from Avro's (1.5.4) AvroOutputFormat to the new MR API.

I've changed the test to extract the common functionality into a helper method because they are the same apart from the two command line arguments.

I could have deleted AvroJob completely but as I was told last time that binary compatibility needs to be maintained I left it in. It's not needed anymore as all necessary functionality can be gotten from Avro's own version of that file as far as I can tell. So if it's okay to delete that redundant file (two actually, cloudera and apache package) let me know and I'll provide a new patch.
All tests pass for hadoopversion=20 but TestColumnTypes fails for me on 23. I can't see how that's related though.
Review request changed
Updated (Feb. 2, 2012, 2:31 p.m.)
Updated to remove any mention of Snappy (which isn't available on Hadoop 1.0.0)
Ship it!
Posted (Feb. 4, 2012, 9:33 p.m.)
Thank you for your time spent on this issue sir.