Review Board 1.7.22


OOZIE-667 Change the way Oozie brings in Hadoop JARs into the build

Review Request #3726 - Created Feb. 1, 2012 and submitted

Alejandro Abdelnur
trunk
OOZIE-667
Reviewers
oozie
oozie
The current mechanism allow to easily package/use new versions of hadoop without complicating Oozie's POMs.

mr1 & mr2 profiles are gone from oozie, now it refers to one of the versions in hadooplibs. 

New maven modules under hadooplib define the hadoop-client/hadoop-test POMs for different hadoop versions.

Note that because of HADOOP-8009, hadoop will start providing a hadoop-client artifact (even for already released versions), still we'll need the corresponding hadooplibs module to be able to use the assembly (as it is done as part of this patch) to pull into the oozie distro the JARs for the supported/tested versions of Hadoop required for the client side.

Note that this can be used tosimplify the logic of addtowar.sh that won't have to be aware of the JARs deps of different versions of Hadoop or of hadoop JARs at all.

Tested with 1.0.0 and 0.24.0-SNAPSHOTs (several testcases failures here but that is still work in progress for the mr2 integration)
Content-Type: text/html; charset=utf-8
trunk/pom.xml
Revision 1239887 New Change
Diff currently unavailable.
Error: The file '/repos/asf/oozie/trunk/pom.xml' (r1239887) could not be found in the repository: '/repos/asf/!svn/bc/1239887/oozie/trunk/pom.xml' path not found
Details
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/views.py", line 117, in view_diff
    request=request)
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/diffutils.py", line 344, in populate_diff_chunks
    chunks = generator.get_chunks()
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/chunk_generator.py", line 137, in get_chunks
    large_data=True)
  File "/usr/local/lib/python2.7/dist-packages/Djblets-0.7.28-py2.7.egg/djblets/util/misc.py", line 157, in cache_memoize
    data = lookup_callable()
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/chunk_generator.py", line 136, in <lambda>
    lambda: list(self._get_chunks_uncached()),
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/chunk_generator.py", line 141, in _get_chunks_uncached
    old = get_original_file(self.filediff, self.request)
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/diffviewer/diffutils.py", line 126, in get_original_file
    request=request)
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/scmtools/models.py", line 192, in get_file
    large_data=True)[0]
  File "/usr/local/lib/python2.7/dist-packages/Djblets-0.7.28-py2.7.egg/djblets/util/misc.py", line 157, in cache_memoize
    data = lookup_callable()
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/scmtools/models.py", line 191, in <lambda>
    request)],
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/scmtools/models.py", line 287, in _get_file_uncached
    data = self.get_scmtool().get_file(path, revision)
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/scmtools/svn.py", line 191, in get_file
    return self._do_on_path(get_file_data, path, revision)
  File "/usr/local/lib/python2.7/dist-packages/ReviewBoard-1.7.22-py2.7.egg/reviewboard/scmtools/svn.py", line 165, in _do_on_path
    raise FileNotFoundError(path, revision, detail=str(e))
FileNotFoundError: The file '/repos/asf/oozie/trunk/pom.xml' (r1239887) could not be found in the repository: '/repos/asf/!svn/bc/1239887/oozie/trunk/pom.xml' path not found
trunk/core/pom.xml
Revision 1239887 New Change
 
trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java
Revision 1239887 New Change
 
trunk/docs/src/site/twiki/AG_Install.twiki
Revision 1239887 New Change
 
trunk/docs/src/site/twiki/DG_QuickStart.twiki
Revision 1239887 New Change
 
trunk/examples/pom.xml
Revision 1239887 New Change
 
trunk/hadooplibs/pom.xml
New File
 
trunk/hadooplibs/hadoop-0_23_1/pom.xml
New File
 
trunk/hadooplibs/hadoop-0_24_0/pom.xml
New File
 
trunk/hadooplibs/hadoop-1_0_0/pom.xml
New File
 
trunk/hadooplibs/hadoop-test-0_23_1/pom.xml
New File
 
trunk/hadooplibs/hadoop-test-0_24_0/pom.xml
New File
 
trunk/hadooplibs/hadoop-test-1_0_0/pom.xml
New File
 
trunk/sharelib/pom.xml
Revision 1239887 New Change
 
trunk/sharelib/streaming/pom.xml
Revision 1239887 New Change
 
trunk/src/main/assemblies/hadooplib.xml
New File
 
trunk/src/main/assemblies/hadooplibs.xml
New File
 
trunk/src/main/assemblies/partial-sharelib.xml
Revision 1239887 New Change
 
trunk/webapp/pom.xml
Revision 1239887 New Change
 
  1. trunk/pom.xml: Loading...
  2. trunk/core/pom.xml: Loading...
  3. trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java: Loading...
  4. trunk/docs/src/site/twiki/AG_Install.twiki: Loading...
  5. trunk/docs/src/site/twiki/DG_QuickStart.twiki: Loading...
  6. trunk/examples/pom.xml: Loading...
  7. trunk/hadooplibs/pom.xml: Loading...
  8. trunk/hadooplibs/hadoop-0_23_1/pom.xml: Loading...
  9. trunk/hadooplibs/hadoop-0_24_0/pom.xml: Loading...
  10. trunk/hadooplibs/hadoop-1_0_0/pom.xml: Loading...
  11. trunk/hadooplibs/hadoop-test-0_23_1/pom.xml: Loading...
  12. trunk/hadooplibs/hadoop-test-0_24_0/pom.xml: Loading...
  13. trunk/hadooplibs/hadoop-test-1_0_0/pom.xml: Loading...
  14. trunk/sharelib/pom.xml: Loading...
  15. trunk/sharelib/streaming/pom.xml: Loading...
  16. trunk/src/main/assemblies/hadooplib.xml: Loading...
  17. trunk/src/main/assemblies/hadooplibs.xml: Loading...
  18. trunk/src/main/assemblies/partial-sharelib.xml: Loading...
  19. trunk/webapp/pom.xml: Loading...