Review Board 1.7.22


SQOOP-1121 Sqoop2: Serialize schema and make them available in the MR job.

Review Request #12261 - Created July 3, 2013 and submitted

Jarek Cecho
SQOOP-1121
Reviewers
Sqoop
sqoop-sqoop2
The patch seems big, but it's just touching a lot of files. Couple of high level notes:

* I've added serialization of the schema into mapreduce job
* I've refactored a bit ConfigurationUtils by providing better encapsulation and adding unit tests for that class.
* I've added the schema to all MR context objects (that are passed to extractor, loader, ...)
* Currently only Connector schema is being used everywhere, I'm expecting to change that once Framework (=hio) schema will be in place.
Provided new unit test for the util class ConfigurationUtils. Both unit and integration tests seems to be working, plus I've tested the changes on real cluster.
Total:
1
Open:
0
Resolved:
1
Dropped:
0
Status:
From:
Review request changed
Updated (July 22, 2013, 9:47 p.m.)
  • changed from pending to submitted