Review Board 1.7.22


SQOOP-599: Import to HBase is not working on secure cluster

Review Request #7011 - Created Sept. 11, 2012 and submitted

Jarek Cecho
SQOOP-599
Reviewers
Sqoop
sqoop-trunk
I've added code that is putting HBase delegation token to mapreduce job.

Unfortunately we're currently still supporting HBase 0.90 that do not have security patches and that is missing required method "obtainAuthTokenForJob". I've used reflection to get the method or ignore state when it's missing.
* ant test -Dhadoopversion={20,100,23,200}
* Manual tests on secure hadoop cluster

Diff revision 1 (Latest)

  1. build.xml: Loading...
  2. src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java: Loading...
build.xml
Revision edcda6e New Change
[20] 171 lines
[+20]
172
  <property name="build.encoding" value="ISO-8859-1"/>
172
  <property name="build.encoding" value="ISO-8859-1"/>
173

    
   
173

   
174
  <!-- testing with JUnit -->
174
  <!-- testing with JUnit -->
175
  <property name="test.junit.output.format" value="plain"/>
175
  <property name="test.junit.output.format" value="plain"/>
176
  <property name="test.output" value="no"/>
176
  <property name="test.output" value="no"/>
177
  <property name="test.timeout" value="300000"/>
177
  <property name="test.timeout" value="600000"/>
178

    
   
178

   
179
  <!-- static analysis -->
179
  <!-- static analysis -->
180
  <property name="findbugs.out.dir" value="${build.dir}/findbugs" />
180
  <property name="findbugs.out.dir" value="${build.dir}/findbugs" />
181
  <property name="findbugs.output.xml.file"
181
  <property name="findbugs.output.xml.file"
182
      value="${findbugs.out.dir}/report.xml" />
182
      value="${findbugs.out.dir}/report.xml" />
[+20] [20] 1044 lines
src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java
Revision 6a784d2 New Change
 
  1. build.xml: Loading...
  2. src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java: Loading...