Review Board 1.7.22


SQOOP-1172 Make Sqoop compatible with HBase 0.95+

Review Request #13524 - Created Aug. 13, 2013 and updated

Jarek Cecho
SQOOP-1172
Reviewers
Sqoop
sqoop-trunk
Tweaked the build system to support both HBase 0.94 and 0.95.
It seems that ant do not accepts "*" for test case names, so one need to execute them one by one:

1) Create list of HBase related test cases:
find . -iname "*HBase*Test.java"  | cut -d"/" -f 8 | sed -re "s/.java//" > hbase-tests

2) Execute each test case one-by-one

2.1) For HBase 0.95 on Hadoop 2.0.0:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=200 -Dhbaseprofile=95 -Dhbasecompatprofile=2 -Dtestcase=$test ; done > log

2.2) For HBase 0.95 on Hadoop 1.0.0:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=100 -Dhbaseprofile=95 -Dhbasecompatprofile=1 -Dtestcase=$test ; done > log

2.2) For HBase 0.94:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=100 -Dtestcase=$test ; done > log

3) See the results:
cat log | grep "\[junit\]" 
Review request changed
Updated (Aug. 13, 2013, 3:47 p.m.)
Removed the need to manually specify HBase compat profile, new testing instructions:

1) Create list of HBase related test cases:
find . -iname "*HBase*Test.java"  | cut -d"/" -f 8 | sed -re "s/.java//" > hbase-tests

2) Execute each test case one-by-one

2.1) For HBase 0.95 on Hadoop 2.0.0:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=200 -Dhbaseprofile=95 -Dtestcase=$test ; done > log

2.2) For HBase 0.95 on Hadoop 1.0.0:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=100 -Dhbaseprofile=95 -Dtestcase=$test ; done > log

2.2) For HBase 0.94:
for test in `cat hbase-tests`; do ant clean test -Dhadoopversion=100 -Dtestcase=$test ; done > log

3) See the results:
cat log | grep "\[junit\]" 
Ship it!
Posted (Aug. 13, 2013, 5:37 p.m.)
Will commit after verifying with tests