Hive参数优化

set hive.exec.dynamic.partition.mode=nonstrict;    
set hive.exec.dynamic.partition=true;
set hive.auto.convert.join = true;
set hive.mapjoin.smalltable.filesize=300000000;
set hive.exec.parallel=true;
set hive.auto.convert.join = true;30000000;
set mapreduce.map.memory.mb=4096;
set mapreduce.reduce.memory.mb=4096;
set yarn.nodemanager.vmem-pmem-ratio=3;
set hive.optimize.skewjoin=true;
set hive.skewjoin.key=1000000;
set mapred.reduce.tasks=10000;
set hive.exec.reducers.bytes.per.reducer=1000000000;

仅限参数，其中的值需要自己衡量。