Review Board 1.7.22


when output hive table to file,users should could have a separator of their own choice

Review Request #10115 - Created March 25, 2013 and updated

fangkun cao
hive-trunk
HIVE-3682
Reviewers
hive
hive
Type: New Feature
Priority: Minor  
Component/s: ql
Problem Definition?when output hive table to file,users should could have a separator of their own choice
Design:
Add a new command "insert overwrite [local] directory '...' [ROW FORMAT row_format] "
Examples :

insert overwrite local directory '${system:test.tmp.dir}/hive_test/multiins_local/src'
row format delimited 
FIELDS TERMINATED BY ':' 
select * from src ;

create table array_table (a array<string>, b array<string>)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
COLLECTION ITEMS TERMINATED BY ',';

load data local inpath "../data/files/array_table.txt" overwrite into table array_table;

insert overwrite local directory '${system:test.tmp.dir}/hive_test/multiins_local/array_table'
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ':'
COLLECTION ITEMS TERMINATED BY '#'
select * from array_table;

CREATE TABLE map_table (foo STRING , bar MAP<STRING, STRING>)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
COLLECTION ITEMS TERMINATED BY ','
MAP KEYS TERMINATED BY ':'
STORED AS TEXTFILE;

load data local inpath "../data/files/map_table.txt" overwrite into table map_table;

insert overwrite local directory '${system:test.tmp.dir}/hive_test/multiins_local/map_table'
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ':'
COLLECTION ITEMS TERMINATED BY '#'
MAP KEYS TERMINATED BY '='
select * from array_table;

Impact Analysis:
Test ideas?

 
Review request changed
Updated (April 8, 2013, 10 a.m.)
  • changed from submitted to pending