BIGTOP-805: Upgrading to Sqoop 2 (and using a generic init script template adapted from Hadoop's services)
Review Request #9264 - Created Feb. 1, 2013 and submitted
This patch upgrades Sqoop from the 1.x series to the 2.x series (that is currently actually at 1.99.1). The new architecture consists of a lightweight client and a centralized server. I've also adapted the init script template used by the Hadoop services and used it for sqoop-server. It's available for all subsequent components that want to make use of it - should make it easier to solve common bugs and be consistent.
I've tested this exact patch on Fedora 17 and Ubuntu Precise, and previous iterations (without significant differences) on RHEL 5, RHEL 6, and Ubuntu Lucid.
|Sean, would it be possible to make sure that all the versions of Hadoop, ZK, etc are bound to the ...||Roman Shaposhnik||March 15, 2013, 4:30 p.m.||Open|
Posted (Feb. 2, 2013, 1:27 a.m.)
Hi Sean, thank you very much for putting this together. I would +1 from Sqoop side, though I won't hit the "Ship It" button as I do not understand all details well enough. I've noticed that there is a lot of trailing white space characters. Most of the projects I know don't like that - I'm not sure about BIGTOP, so just saying.
Calling the "site" target should not be necessary here. Also we might want to explicitly add -Dhadoop.profile=200 so that it will build against Hadoop 2.0.0. I know that it's current default, but that might change and cause unnecessary issues.
I'm wondering where is this script being executed? I did not found it's reference anywhere other than installation files.
Posted (March 15, 2013, 12:18 a.m.)
Posted (March 15, 2013, 4:30 p.m.)
Review request changed
Updated (April 25, 2013, 4:28 p.m.)
- changed from pending to submitted