Review Board 1.7.22


PIG-3502 Initial implementation of TezLauncher

Review Request #14601 - Created Oct. 11, 2013 and submitted

Cheolsoo Park
tez-branch
PIG-3502
Reviewers
pig
daijy, mwagner, rohini
pig-git
Initial implementation of TezLauncher. The patch includes the following changes:
- Refactors Launcher and MapReduceLauncher. Basically, I moved what's MR-specific to MapReduceLauncher and kept what's common in Launcher.
- Removes kill() method from ExecutionEngine interface. It was used merely by Launcher, and it didn't seem useful. 
- Implements the DAG submission of TezLauncher. Basically, I overrode the submit() method in TezJob (extension of ControlledJob) that calls DAGClient.submit().
- Adds a skeleton TezStats class that extends PigStats. This class needs to be implemented to monitor job status after submission.
- Adds a unit test called TestTezLauncher. For now, all it does is to compile queries and submit a DAG. More meaningful unit tests will be added after TezStats is implemented.
- Adds a TezLocalExecType. To start up a YARN mini cluster, I needed non-local Tez mode. So I created "tez_local" and "tez" modes.
- Whitespace and indentation fixes.
TestTezLauncher is added.
Total:
2
Open:
2
Resolved:
0
Dropped:
0
Status:
From:
Review request changed
Updated (Oct. 14, 2013, 6:55 p.m.)
  • changed from pending to submitted