Review Board 1.7.22


HBASE-5317: Fix TestHFileOutputFormat to work against hadoop 0.23

Review Request #3939 - Created Feb. 16, 2012 and updated

Gregory Chanan
trunk
HBASE-5317
Reviewers
hbase
stack, tedyu
hbase-git
NOTE: To get TestHFileOutputFormat passing also requires HBASE-5346, which has been reviewed but not committed yet.

Fixes a few issues interacting with the new mapreduce in 0.23:
- Maven dependency issue
- Change the hbaseRootDir so that mrv2 output is not confused with an hbase table
- Create Jars necessary to run mrv2 jobs at unit test time (before hbase jars have been built) 

 
pom.xml
Revision 066c027 New Change
[20] 1844 lines
[+20]
1845
                  </resources>
1845
                  </resources>
1846
                </configuration>
1846
                </configuration>
1847
              </execution>
1847
              </execution>
1848
            </executions>
1848
            </executions>
1849
          </plugin>
1849
          </plugin>

    
   
1850
          <plugin>

    
   
1851
            <artifactId>maven-dependency-plugin</artifactId>

    
   
1852
            <executions>

    
   
1853
              <execution>

    
   
1854
                <id>create-mrapp-generated-classpath</id>

    
   
1855
                <phase>generate-test-resources</phase>

    
   
1856
                <goals>

    
   
1857
                  <goal>build-classpath</goal>

    
   
1858
                </goals>

    
   
1859
                <configuration>

    
   
1860
                  <!-- needed to run the unit test for DS to generate

    
   
1861
                  the required classpath that is required in the env

    
   
1862
                  of the launch container in the mini mr/yarn cluster

    
   
1863
                  -->

    
   
1864
                  <outputFile>${project.build.directory}/test-classes/mrapp-generated-classpath</outputFile>

    
   
1865
                </configuration>

    
   
1866
              </execution>

    
   
1867
            </executions>

    
   
1868
          </plugin>
1850
        </plugins>
1869
        </plugins>
1851
      </build>
1870
      </build>
1852
    </profile>
1871
    </profile>
1853

    
   
1872

   
1854
    <!-- profiles for the tests
1873
    <!-- profiles for the tests
[+20] [20] 278 lines
src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat.java
Revision c5222c2 New Change
 
src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
Revision ff38731 New Change
 
src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
Revision ec9d581 New Change
 
src/test/java/org/apache/hadoop/hbase/client/TestMetaMigrationRemovingHTD.java
Revision 7c5e108 New Change
 
  1. pom.xml: Loading...
  2. src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat.java: Loading...
  3. src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java: Loading...
  4. src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java: Loading...
  5. src/test/java/org/apache/hadoop/hbase/client/TestMetaMigrationRemovingHTD.java: Loading...