.BigTop Components v1.0
Bigtop Component | Package Version in BigTop v1.2 | Version in Bigtop Upstream | Version in Upstream | Version in ERP17.12 | Version in ERP18.06 | Package Version in BigTop v1.4 | Package Version in BigTop master branch upstream based on bigtop.bom file |
Hadoop | 2.7.3 | 2.8.1 | 2.6.5 / 2.7.6 / 2.8.4 / 2.9.1 / 3.1.0 | 2.8.4 | 2.8.4=>2.8.5 | 2.8.5 | |
Spark | 1.4.6 / 2.1.1 | 2.2.1 | 2.3.1 | 2.2.1 | 2.2.1=>2.2.3 | 2.2.3 | |
Hive | 1.2.1 | 2.3.2 | 2.3.3/3.0.0 | 2.3.3 | 2.3.3 | 2.3.3 | |
HBase | 1.1.3 | 1.3.1 | 1.3.2 / 1.3.3 / 2.0.1 | 1.3.2 | 1.3.2 | 1.3.2 | |
Ambari | 2.5.0 | 2.5.2 | 2.6.2 | 2.6.1 | 2.6.1 | 2.6.1 | |
Zookeeper | 3.4.6 | 3.4.6 | 3.4.12 / 3.5.4 | 3.4.6 | 3.4.6 | 3.4.6 | |
Alluxio | 1.0.1 | 1.0.1=>1.8.1 | 1.8.1 | ||||
Apex | 3.5.0 | 3.6.0 | 3.6.0 | ||||
bigtop_groovy | 2.4.10 | 2.4.10 | 2.4.10 | ||||
bigto_jsvc | 1.0.15 | 1.0.15 | 1.0.15 | ||||
bigtop_tomcat | 6.0.45 | 6.0.45 | 6.0.45 | ||||
bigtop_utils | 1.2.0 | 1.3.0 | bigtop.version | ||||
Crunch | 0.14.0 | 0.15.0=>Removed | Removed | ||||
Pig UDF Datafu | 1.3.0 | Removed | Removed | ||||
Flink | 1.1.3 | 1.4.2=>1.6.4 | 1.6.4 | ||||
Flume | 1.7.0 | 1.8.0 | 1.8.0 | ||||
Giraph | 1.1.0 | 1.1.0 | 1.1.0 | ||||
Greenplum | 5.0.0-alpha-0 | Removed | Removed | ||||
gpdb | 5.10.0 | 5.10.0 | |||||
Hama | 0.7.0 | 0.7.1 | 0.7.1 | ||||
removed after Bigtop v1.2 | Removed | Removed | |||||
Ignite | 1.9.0 | 1.9.0 | 1.9.0 | ||||
Kafka | 0.10.1.1 | 0.10.2.2 | 0.10.2.2 | ||||
Kite | 1.1.0 | Removed | Removed | ||||
Mahout | 0.12.2 | 0.13.0 | 0.13.0 | ||||
Oozie | 4.3.0 | 4.3.0=>Enabled Back | 4.3.0 | ||||
Pheonix | 4.9.0-HBase-1.1 | 4.13.1-HBase-1.3 | 4.13.1-HBase-1.3 | ||||
Pig | 0.15.0 | Removed | Removed | ||||
QFS | 1.1.4 | 2.0.0 | 2.0.0 | ||||
Solr | 4.10.4 | 6.6.0 | 6.6.0 | 6.6.0 | |||
Sqoop | 1.4.6 / 1.99.4 | 1.4.6 | 1.4.6 | ||||
Sqoop2 | 1.99.4 | 1.99.4 | |||||
Tajo | 0.11.1 | 0.11.1 | 0.11.1 | ||||
Tez | 0.6.2 | 0.9.1 | 0.9.1 | ||||
ycsb | 0.4.0 | 0.12.0 | 0.12.0 | ||||
Zeppelin | 0.7.0 | 0.7.3 | 0.7.3 |
Components compatibilties
Hadoop + HBase: http://hbase.apache.org/book.html#hadoop
Hadoop + Spark: https://issues.apache.org/jira/browse/SPARK-23534
Hadoop + Hive: Hadoop 3.0 + Hive 3.0.0; Hadoop 2.x + Hive 2.3.x
Hadoop + Oozie: https://issues.apache.org/jira/browse/OOZIE-2973
Hadoop + Pig: https://issues.apache.org/jira/browse/PIG-5253
Hadoop + Tez: https://issues.apache.org/jira/browse/TEZ-3923, https://issues.apache.org/jira/browse/TEZ-3252
Hadoop + Solr: https://issues.apache.org/jira/browse/SOLR-9515, https://issues.apache.org/jira/browse/SOLR-9761