Review Board 1.7.22


FLUME-2089 ElasticsearchSink blocks and raises exceptions when event body has unexpected encoding

Review Request #13509 - Created Aug. 12, 2013 and updated

Edward Sargisson
Reviewers
Flume
flume-git
The ElasticsearchSink is quite aggressive in assuming that the incoming event is JSON. However, if it is not JSON or YAML then an exception is thrown which would block the queue from processing further messages. 
This patch catches Exception and writes the data as a simple field.
Mvn install passes.
A custom build with this patch is currently running in many of our environments with no problems and the event which caused the issue was safely stored.
Ship it!
Posted (Aug. 25, 2013, 12:46 a.m.)
Ship It!
  1. I think for future reviews, we should try to add the branch (flume-1.4), this will make things easier to test out if the reviewer wishes to download the patch and test out the code without making assumptions about which branch the patch was created from.