HiveTestBench
About Hive TestBench
The information available on [[https://github.com/hortonworks/hive-testbench|Hive TestBench]] web page.
Compilation and Run of Hive TestBench
Create a local clone
Clone the Hive TestBench
$ git clone https://github.com/hortonworks/hive-testbench.git
Compile the benchmark
Compile the benchmark using the scripts
$ ./tpcds-build.sh
$ ./tpch-build.sh
Choose the scale of data on which to run the tests Under 4 nodes, less than 100-250GB, 4-10 nodes should handle 1TB, Large clusters can scale up to higher values
Prepare data for the scale
As an example
$ ./tpcds-setup.sh 1000
$ ./tpch-setup.sh 1000
By default this creates tables in ORC format, you can choose a different format by setting
FORMAT=<SEQUENCEFILE, TEXTFILE, RCFILE, ORC, PARQUET, or AVRO>
For example; FORMAT=rcfile ./tpcds-setup.sh 30000
Run queries
You can use hive, beeline or any SQL tool
TPC-DS
cd sample-queries-tpcds
hive -i testbench.settings
hive> use tpcds_bin_partitioned_orc_1000;
hive> source query55.sql;
TPC-H
cd sample-queries-tpch
hive -i testbench.settings
hive> use tpch_flat_orc_1000;
hive> source tpch_query1.sql;