Review Board 1.7.22


Flume-1541: Implement a SinkSelector for LoadBalancingSinkProcessor that includes failover mechanics

Review Request #6939 - Created Sept. 6, 2012 and submitted

Juhani Connolly
FLUME-1541
Reviewers
Flume
flume-git
Added a callback to the SinkSelector interface to inform selectors of sink failures, adding a noop stub to the abstract source so existing selectors don't need changes.

The new selector maintains counts of sequential failures as well as times for intended recovery and last failure time, which it uses to decide whether or not a sink should be added to the returned iterator. The iterator is generated in such a way that the round robin remains balanced.
Added 3 new tests to verify that dynamic rebalancing is done, that the sink becomes available again after timeout, and that the timeout increases with sequential failures

All tests pass
Total:
2
Open:
0
Resolved:
2
Dropped:
0
Status:
From:
Description From Last Updated Status
Review request changed
Updated (Sept. 6, 2012, 9:26 a.m.)
  • changed from pending to submitted