Review Board 1.7.22


SQOOP-1220 Sqoop2: Improve default catalina.properties file to work out of the box on both Hadoop 1 and 2

Review Request #14795 - Created Oct. 21, 2013 and updated

Jarek Cecho
SQOOP-1220
Reviewers
Sqoop
sqoop-sqoop2
I've tweak the configuration in a way that it works out of the box on both Hadoop 1 and Hadoop 2 (BigTop based installations). There is one caveat though, on Hadoop 1.0 when stopping server, following warning will be printed out:

Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-hdfs], exists: [false], isDirectory: [false], canRead: [false]
Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-hdfs/lib], exists: [false], isDirectory: [false], canRead: [false]
Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-mapreduce], exists: [false], isDirectory: [false], canRead: [false]
Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-mapreduce/lib], exists: [false], isDirectory: [false], canRead: [false]
Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-yarn], exists: [false], isDirectory: [false], canRead: [false]
Oct 21, 2013 1:06:07 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/lib/hadoop-yarn/lib], exists: [false], isDirectory: [false], canRead: [false]

The warnings are harmless and are printed out only while shutting the server down, so hopefully they won't be confusing users who are running default configuration on Hadoop 1.
Tried the default config file on both Hadoop 1 (BigTop 0.3) and Hadoop 2 (BigTop 0.6).
Ship it!
Posted (Oct. 25, 2013, 12:16 a.m.)
Ship It!