Review Board 1.7.22


HIVE-5095: Hive needs new operator walker for parallelization/optimization for tez

Review Request #13787 - Created Aug. 23, 2013 and updated

Vikram Dixit Kumaraswamy
tez
HIVE-5095
Reviewers
hive
haglein
hive-git
For tez to compute the number of reducers, we should be walking the operator tree in a topological fashion so that the reducers down the tree get the estimate from all parents. However, the current walkers in hive only walk the operator tree in a depth-first fashion. We need to add a new walker for the topological walk. Also, since information about the parent operators needs to be propagated on a per parent basis, we need to retain some context across operators to be passed to the child which the walker will co-ordinate.