Review Board 1.7.22


FLUME-1842.AsyncHBaseSink timeout is not calculated correctly

Review Request #8968 - Created Jan. 16, 2013 and submitted

Hari Shreedharan
FLUME-1842
Reviewers
Flume
flume-git
Made changes to calculate remaining time and wait only for that long
Added unit test. Current tests pass
flume-ng-doc/sphinx/FlumeUserGuide.rst
Revision 58a115e New Change
[20] 1536 lines
[+20]
1537
**table**         --                                                            The name of the table in Hbase to write to.
1537
**table**         --                                                            The name of the table in Hbase to write to.
1538
zookeeperQuorum   --                                                            The quorum spec. This is the value for the property ``hbase.zookeeper.quorum`` in hbase-site.xml
1538
zookeeperQuorum   --                                                            The quorum spec. This is the value for the property ``hbase.zookeeper.quorum`` in hbase-site.xml
1539
znodeParent       /hbase                                                        The base path for the znode for the -ROOT- region. Value of ``zookeeper.znode.parent`` in hbase-site.xml
1539
znodeParent       /hbase                                                        The base path for the znode for the -ROOT- region. Value of ``zookeeper.znode.parent`` in hbase-site.xml
1540
**columnFamily**  --                                                            The column family in Hbase to write to.
1540
**columnFamily**  --                                                            The column family in Hbase to write to.
1541
batchSize         100                                                           Number of events to be written per txn.
1541
batchSize         100                                                           Number of events to be written per txn.
1542
timeout           --                                                            The length of time (in milliseconds) the sink waits for acks from hbase for
1542
timeout           60000                                                         The length of time (in milliseconds) the sink waits for acks from hbase for
1543
                                                                                all events in a transaction. If no timeout is specified, the sink will wait forever.
1543
                                                                                all events in a transaction.
1544
serializer        org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
1544
serializer        org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
1545
serializer.*      --                                                            Properties to be passed to the serializer.
1545
serializer.*      --                                                            Properties to be passed to the serializer.
1546
================  ============================================================  ====================================================================================
1546
================  ============================================================  ====================================================================================
1547

    
   
1547

   
1548
Note that this sink takes the Zookeeper Quorum and parent znode information in
1548
Note that this sink takes the Zookeeper Quorum and parent znode information in
[+20] [20] 1218 lines
flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java
Revision 6b34873 New Change
 
flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkConfigurationConstants.java
Revision fad026c New Change
 
flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestAsyncHBaseSink.java
Revision 1f61406 New Change
 
  1. flume-ng-doc/sphinx/FlumeUserGuide.rst: Loading...
  2. flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHBaseSink.java: Loading...
  3. flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSinkConfigurationConstants.java: Loading...
  4. flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestAsyncHBaseSink.java: Loading...