Review Board 1.7.22


FLUME-1502: Support for running simple configurations embedded in host process

Review Request #8127 - Created Nov. 19, 2012 and submitted

Brock Noland
FLUME-1502
FLUME-1502
Reviewers
Flume
flume-git
Patch is on top of the FLUME-1502 branch which has 1630 committed to it.

This patch creates a module flume-ng-embedded-agent which implements FLUME-1502. The patch is not read for commit. Specifically, it needs the following:

1) whitespace removal
2) docs in package-info.java and the developer guide

However, I'd like to start soliciting feedback as these are not items which will affect it's overall design.
Additional unit tests have been added and they pass.

Diff revision 1

This is not the most recent revision of the diff. The latest diff is revision 3. See what's changed.

1 2 3
1 2 3

  1. pom.xml: Loading...
  2. flume-ng-configuration/src/main/java/org/apache/flume/conf/FlumeConfiguration.java: Loading...
  3. flume-ng-core/src/main/java/org/apache/flume/sink/SinkProcessorFactory.java: Loading...
  4. flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java: Loading...
  5. flume-ng-dist/pom.xml: Loading...
  6. flume-ng-embedded-agent/pom.xml: Loading...
  7. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/AvroLocalSource.java: Loading...
  8. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgent.java: Loading...
  9. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgentConfiguration.java: Loading...
  10. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedSource.java: Loading...
  11. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/LocalSource.java: Loading...
  12. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MaterializedConfigurationProvider.java: Loading...
  13. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MemoryConfigurationProvider.java: Loading...
  14. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/package-info.java: Loading...
  15. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentAvroSource.java: Loading...
  16. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentConfiguration.java: Loading...
  17. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentEmbeddedSource.java: Loading...
  18. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentState.java: Loading...
  19. flume-ng-embedded-agent/src/test/resources/log4j.properties: Loading...
pom.xml
Revision 76b8351 New Change
[20] 44 lines
[+20]
45
  </properties>
45
  </properties>
46

    
   
46

   
47
  <modules>
47
  <modules>
48
    <module>flume-ng-core</module>
48
    <module>flume-ng-core</module>
49
    <module>flume-ng-configuration</module>
49
    <module>flume-ng-configuration</module>

    
   
50
    <module>flume-ng-embedded-agent</module>
50
    <module>flume-ng-sinks</module>
51
    <module>flume-ng-sinks</module>
51
    <module>flume-ng-sources</module>
52
    <module>flume-ng-sources</module>
52
    <module>flume-ng-node</module>
53
    <module>flume-ng-node</module>
53
    <module>flume-ng-dist</module>
54
    <module>flume-ng-dist</module>
54
    <module>flume-ng-channels</module>
55
    <module>flume-ng-channels</module>
[+20] [20] 935 lines
flume-ng-configuration/src/main/java/org/apache/flume/conf/FlumeConfiguration.java
Revision 9b209e8 New Change
 
flume-ng-core/src/main/java/org/apache/flume/sink/SinkProcessorFactory.java
Revision f39b919 New Change
 
flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java
Revision 47ccf9f New Change
 
flume-ng-dist/pom.xml
Revision d929c88 New Change
 
flume-ng-embedded-agent/pom.xml
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/AvroLocalSource.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgent.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgentConfiguration.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedSource.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/LocalSource.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MaterializedConfigurationProvider.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MemoryConfigurationProvider.java
New File
 
flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/package-info.java
New File
 
flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentAvroSource.java
New File
 
flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentConfiguration.java
New File
 
flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentEmbeddedSource.java
New File
 
flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentState.java
New File
 
flume-ng-embedded-agent/src/test/resources/log4j.properties
New File
 
  1. pom.xml: Loading...
  2. flume-ng-configuration/src/main/java/org/apache/flume/conf/FlumeConfiguration.java: Loading...
  3. flume-ng-core/src/main/java/org/apache/flume/sink/SinkProcessorFactory.java: Loading...
  4. flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java: Loading...
  5. flume-ng-dist/pom.xml: Loading...
  6. flume-ng-embedded-agent/pom.xml: Loading...
  7. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/AvroLocalSource.java: Loading...
  8. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgent.java: Loading...
  9. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgentConfiguration.java: Loading...
  10. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedSource.java: Loading...
  11. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/LocalSource.java: Loading...
  12. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MaterializedConfigurationProvider.java: Loading...
  13. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/MemoryConfigurationProvider.java: Loading...
  14. flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/package-info.java: Loading...
  15. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentAvroSource.java: Loading...
  16. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentConfiguration.java: Loading...
  17. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentEmbeddedSource.java: Loading...
  18. flume-ng-embedded-agent/src/test/java/org/apache/flume/agent/embedded/TestEmbeddedAgentState.java: Loading...
  19. flume-ng-embedded-agent/src/test/resources/log4j.properties: Loading...