Review Board 1.7.22


FLUME-2027: Check for default replication fails on federated cluster in hdfs sink

Review Request #10834 - Created April 29, 2013 and updated

Mike Percy
FLUME-2027
Reviewers
Flume
flume-git
Federated HDFS has a new API which has been ported to Hadoop 1.1.0 and Hadoop 2.0.0-alpha from HADOOP-8014 which takes a Path argument to the FileSystem.getDefaultReplication() call. This patch simply moves the existing implementation over to that new API.
Unit tests pass.

Tested this by running the unit tests under both Hadoop 1.0.1 and Hadoop 1.1.2 (manually modified the pom files) and looking at the DEBUG output from the unit tests. The debug output indicated that HADOOP-8014 is used if it's available, otherwise the existing API is used. This should be sufficient for all cases.
Total:
1
Open:
1
Resolved:
0
Dropped:
0
Status:
From:
Review request changed
Updated (May 1, 2013, 7:36 a.m.)
  • Unit tests pass.

    Unit tests pass.
    
    Tested this by running the unit tests under both Hadoop 1.0.1 and Hadoop 1.1.2 (manually modified the pom files) and looking at the DEBUG output from the unit tests. The debug output indicated that HADOOP-8014 is used if it's available, otherwise the existing API is used. This should be sufficient for all cases.
Ship it!
Posted (May 6, 2013, 9:26 p.m.)
Ship It!
Ship it!
Posted (July 17, 2013, 11:45 p.m.)
looks good
Ship it!
Posted (July 17, 2013, 11:45 p.m.)
looks good