FLUME-2027: Check for default replication fails on federated cluster in hdfs sink
Review Request #10834 - Created April 29, 2013 and updated
Federated HDFS has a new API which has been ported to Hadoop 1.1.0 and Hadoop 2.0.0-alpha from HADOOP-8014 which takes a Path argument to the FileSystem.getDefaultReplication() call. This patch simply moves the existing implementation over to that new API.
Unit tests pass. Tested this by running the unit tests under both Hadoop 1.0.1 and Hadoop 1.1.2 (manually modified the pom files) and looking at the DEBUG output from the unit tests. The debug output indicated that HADOOP-8014 is used if it's available, otherwise the existing API is used. This should be sufficient for all cases.
|We should probably not bump the version up to 1.1.0, rather use reflection to call the method.||Hari Shreedharan||April 30, 2013, 5:30 a.m.||Open|