Review Board 1.7.22


SQOOP-658 Solve hadoop dependency distribution/loading on server side

Review Request #7860 - Created Nov. 4, 2012 and submitted

Jarek Cecho
SQOOP-658
Reviewers
Sqoop
sqoop-sqoop2
I've ported Oozie's script for populating hadoop binaries to Oozie server to Sqoop (and Sqoop server). Basically user have to manually execute command ./bin/addtowar.sh to install hadoop binaries. Right now, only hadoop 2.0.0 is supported.
I've tested it on CDH 4.1.1 with following execution:

./bin/addtowar.sh -hadoop 2.0 /usr/lib/hadoop/client/ -jars /usr/lib/sqoop/lib/mysql-connector-java-5.1.21-bin.jar:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.1.1.jar
* Base hadoop version is 2.0
* Adding MySQL JDBC driver to test MySQL data import
* Adding MR1 implementation that is specific to CDH
Review request changed
Updated (Nov. 7, 2012, 6:23 p.m.)
  • changed from pending to submitted