Review Board 1.7.22


BIGTOP-805: Upgrading to Sqoop 2 (and using a generic init script template adapted from Hadoop's services)

Review Request #9264 - Created Feb. 1, 2013 and submitted

Sean Mackrory
master
BIGTOP-805
Reviewers
bigtop
jarcec
bigtop
This patch upgrades Sqoop from the 1.x series to the 2.x series (that is currently actually at 1.99.1). The new architecture consists of a lightweight client and a centralized server. I've also adapted the init script template used by the Hadoop services and used it for sqoop-server. It's available for all subsequent components that want to make use of it - should make it easier to solve common bugs and be consistent.
I've tested this exact patch on Fedora 17 and Ubuntu Precise, and previous iterations (without significant differences) on RHEL 5, RHEL 6, and Ubuntu Lucid.
bigtop.mk
Revision 96f2257 New Change
[20] 85 lines
[+20]
86

    
   
86

   
87
# Sqoop
87
# Sqoop
88
SQOOP_NAME=sqoop
88
SQOOP_NAME=sqoop
89
SQOOP_RELNOTES_NAME=Sqoop
89
SQOOP_RELNOTES_NAME=Sqoop
90
SQOOP_PKG_NAME=sqoop
90
SQOOP_PKG_NAME=sqoop
91
SQOOP_BASE_VERSION=1.4.2
91
SQOOP_BASE_VERSION=1.99.1
92
SQOOP_PKG_VERSION=1.4.2
92
SQOOP_PKG_VERSION=1.99.1
93
SQOOP_RELEASE_VERSION=1
93
SQOOP_RELEASE_VERSION=1
94
SQOOP_TARBALL_DST=$(SQOOP_NAME)-$(SQOOP_BASE_VERSION).tar.gz
94
SQOOP_TARBALL_DST=$(SQOOP_NAME)-$(SQOOP_BASE_VERSION).tar.gz
95
SQOOP_TARBALL_SRC=$(SQOOP_TARBALL_DST)
95
SQOOP_TARBALL_SRC=$(SQOOP_TARBALL_DST)
96
SQOOP_DOWNLOAD_PATH=/sqoop/$(SQOOP_BASE_VERSION)
96
SQOOP_DOWNLOAD_PATH=/sqoop/$(SQOOP_BASE_VERSION)
97
SQOOP_SITE=$(APACHE_MIRROR)$(SQOOP_DOWNLOAD_PATH)
97
SQOOP_SITE=$(APACHE_MIRROR)$(SQOOP_DOWNLOAD_PATH)
[+20] [20] 164 lines
package.mk
Revision 8e45771 New Change
 
bigtop-packages/src/common/sqoop/catalina.properties
New File
 
bigtop-packages/src/common/sqoop/do-component-build
Revision 42a2442 New Change
 
bigtop-packages/src/common/sqoop/install_sqoop.sh
Revision 771931a New Change
 
bigtop-packages/src/common/sqoop/setenv.sh
New File
 
bigtop-packages/src/common/sqoop/sqoop.sh
New File
 
bigtop-packages/src/common/sqoop/sqoop.properties
New File
 
bigtop-packages/src/common/sqoop/sqoop.default
New File
 
bigtop-packages/src/common/sqoop/sqoop-metastore.sh
Revision ab22ef3 New Change
 
bigtop-packages/src/common/sqoop/sqoop-metastore.sh.suse
Revision bcc1fef New Change
 
bigtop-packages/src/common/sqoop/sqoop-server.svc
New File
 
bigtop-packages/src/common/sqoop/sqoop-server.sh
New File
 
bigtop-packages/src/deb/sqoop/changelog
Revision 547ed02 New Change
 
bigtop-packages/src/deb/sqoop/compat
Revision 7f8f011 New Change
 
bigtop-packages/src/deb/sqoop/control
Revision dcc6106 New Change
 
bigtop-packages/src/deb/sqoop/copyright
Revision ec176a9 New Change
 
bigtop-packages/src/deb/sqoop/rules
Revision 7992dcd New Change
 
bigtop-packages/src/deb/sqoop/sqoop.prerm
Revision b9a25a5 New Change
 
bigtop-packages/src/deb/sqoop/sqoop.preinst
New File
 
bigtop-packages/src/deb/sqoop/sqoop.postinst
Revision 37cae7e New Change
 
bigtop-packages/src/deb/sqoop/sqoop.install
New File
 
bigtop-packages/src/deb/sqoop/sqoop-client.install
New File
 
bigtop-packages/src/deb/sqoop/sqoop-metastore.preinst
Revision 76cfb26 New Change
 
bigtop-packages/src/deb/sqoop/sqoop-metastore.postinst
Revision b8b6635 New Change
 
bigtop-packages/src/deb/sqoop/sqoop-server.postinst
New File
 
bigtop-packages/src/deb/sqoop/sqoop-server.install
New File
 
bigtop-packages/src/rpm/sqoop/SPECS/sqoop.spec
Revision 9774326 New Change
 
bigtop-packages/src/templates/init.d.tmpl
New File
 
  1. bigtop.mk: Loading...
  2. package.mk: Loading...
  3. bigtop-packages/src/common/sqoop/catalina.properties: Loading...
  4. bigtop-packages/src/common/sqoop/do-component-build: Loading...
  5. bigtop-packages/src/common/sqoop/install_sqoop.sh: Loading...
  6. bigtop-packages/src/common/sqoop/setenv.sh: Loading...
  7. bigtop-packages/src/common/sqoop/sqoop.sh: Loading...
  8. bigtop-packages/src/common/sqoop/sqoop.properties: Loading...
  9. bigtop-packages/src/common/sqoop/sqoop.default: Loading...
  10. bigtop-packages/src/common/sqoop/sqoop-metastore.sh: Loading...
  11. bigtop-packages/src/common/sqoop/sqoop-metastore.sh.suse: Loading...
  12. bigtop-packages/src/common/sqoop/sqoop-server.svc: Loading...
  13. bigtop-packages/src/common/sqoop/sqoop-server.sh: Loading...
  14. bigtop-packages/src/deb/sqoop/changelog: Loading...
  15. bigtop-packages/src/deb/sqoop/compat: Loading...
  16. bigtop-packages/src/deb/sqoop/control: Loading...
  17. bigtop-packages/src/deb/sqoop/copyright: Loading...
  18. bigtop-packages/src/deb/sqoop/rules: Loading...
  19. bigtop-packages/src/deb/sqoop/sqoop.prerm: Loading...
  20. bigtop-packages/src/deb/sqoop/sqoop.preinst: Loading...
  21. bigtop-packages/src/deb/sqoop/sqoop.postinst: Loading...
  22. bigtop-packages/src/deb/sqoop/sqoop.install: Loading...
  23. bigtop-packages/src/deb/sqoop/sqoop-client.install: Loading...
  24. bigtop-packages/src/deb/sqoop/sqoop-metastore.preinst: Loading...
  25. bigtop-packages/src/deb/sqoop/sqoop-metastore.postinst: Loading...
  26. bigtop-packages/src/deb/sqoop/sqoop-server.postinst: Loading...
  27. bigtop-packages/src/deb/sqoop/sqoop-server.install: Loading...
  28. bigtop-packages/src/rpm/sqoop/SPECS/sqoop.spec: Loading...
  29. bigtop-packages/src/templates/init.d.tmpl: Loading...