Review Board 1.7.22

HBase sink to ng

Review Request #3741 - Created Feb. 2, 2012 and updated

Karthik K
HBase Sink, ported to Flume NG. 

Configurable EventToPutDecoder in place. 
Tested with the DefaultEventToPutDecoder in place, to map Event-s to Put-s. 
Review request changed
Updated (Feb. 2, 2012, 11:24 p.m.)
  • changed from to flume-728
Posted (Feb. 13, 2012, 2:48 a.m.)
Changes look good. Some feedback follows:

* Please remove trailing whitespaces and tabs where present. These are highlighted in red on the review board diff.

* The change is missing tests. Since this is an important feature enhancement, it is necessary to have some basic testing in place to assert that it works and continues to work.

* The implementation of the decoder depends upon pre-existing headers in the event. While this will work for planned flows that need to end up in HBase, it will not work that well for adhoc flows that the user wishes to route to HBase. In such cases, the requirement to have these headers in place will come in the way of making use of this. It is therefore preferable to have an alternate implementation that uses static configuration to place the events in HBase as well. 
The default implementation uses a few hardcoded header names. There should be a mechanism to override these via configuration if necessary.