Review Board 1.7.22


FLUME-1992 ElasticSearch dependency is marked optional

Review Request #10709 - Created April 22, 2013 and discarded

Edward Sargisson
Reviewers
Flume
flume-git
Added info to user guide as users will need to select which JAR they use.

 

Diff revision 1 (Latest)

  1. flume-ng-doc/sphinx/FlumeUserGuide.rst: Loading...
flume-ng-doc/sphinx/FlumeUserGuide.rst
Revision 38f2205 New Change
[20] 1751 lines
[+20]
1752

    
   
1752

   
1753
This sink writes data to ElasticSearch. A class implementing
1753
This sink writes data to ElasticSearch. A class implementing
1754
ElasticSearchEventSerializer which is specified by the configuration is used to convert the events into
1754
ElasticSearchEventSerializer which is specified by the configuration is used to convert the events into
1755
XContentBuilder which detail the fields and mappings which will be indexed. These are then then written
1755
XContentBuilder which detail the fields and mappings which will be indexed. These are then then written
1756
to ElasticSearch. The sink will generate an index per day allowing easier management instead of dealing with
1756
to ElasticSearch. The sink will generate an index per day allowing easier management instead of dealing with
1757
a single large index
1757
a single large index.
1758
The type is the FQCN: org.apache.flume.sink.elasticsearch.ElasticSearchSink
1758

   

    
   
1759
Note that this sink does **not** include the elasticsearch and lucene-core JARs required. You will need to provide your

    
   
1760
own JARs based on version of the elasticsearch cluster you are connecting to. These JARs should be placed in the /lib dir

    
   
1761
of your Flume installation. This is because elasticsearch changes

    
   
1762
major versions when they introduce backwards-incompatible serialization changes. To determine which version of 

    
   
1763
lucene-core to include it is recommended to review the pom.xml for the elasticsearch jar you are using.

    
   
1764
 

    
   
1765
The type is the FQCN: org.apache.flume.sink.elasticsearch.ElasticSearchSink.
1759
Required properties are in **bold**.
1766
Required properties are in **bold**.
1760

    
   
1767

   
1761
================  ==================================================================  =======================================================================================================
1768
================  ==================================================================  =======================================================================================================
1762
Property Name     Default                                                             Description
1769
Property Name     Default                                                             Description
1763
================  ==================================================================  =======================================================================================================
1770
================  ==================================================================  =======================================================================================================
[+20] [20] 1262 lines
  1. flume-ng-doc/sphinx/FlumeUserGuide.rst: Loading...