BigTop Components
Bigtop Component | Version in Bigtop v1.2 | Version in Bigtop Upstream | Version in Upstream | Version in ERP17.12 | Version in ERP18.06 |
Hadoop | 2.7.3 | 2.8.1 | 2.6.5 / 2.7.6 / 2.8.4 / 2.9.1 / 3.1.0 | 2.8.4 | |
Spark | 1.4.6 / 2.1.1 | 2.2.1 | 2.3.1 | 2.2.1 | |
Hive | 1.2.1 | 2.3.2 | 2.3.3/3.0.0 | 2.3.3 | |
HBase | 1.1.3 | 1.3.1 | 1.3.2 / 1.3.3 / 2.0.1 | 1.3.2 | |
Ambari | 2.5.0 | 2.5.2 | 2.6.2 | 2.6.1 | |
Zookeeper | 3.4.6 | 3.4.6 | 3.4.12 / 3.5.4 | 3.4.6 | |
Alluxio | 1.0.1 | ||||
Apex | 3.5.0 | ||||
Groovy | 2.4.10 | ||||
Apache Commons - jsvc | 1.0.15 | ||||
Tomcat | 6.0.45 | ||||
Bigtop_Utils | 1.2.0 | ||||
Crunch | 0.14.0 | ||||
Pig UDF Datafu | 1.3.0 | ||||
Flink | 1.1.3 | ||||
Flume | 1.7.0 | ||||
Giraph | 1.1.0 | ||||
Greenplum | 5.0.0-alpha-0 | ||||
Hama | 0.7.0 | ||||
removed after Bigtop v1.2 | |||||
Ignite | 1.9.0 | ||||
Kafka | 0.10.1.1 | ||||
Kite | 1.1.0 | ||||
Mahout | 0.12.2 | ||||
Oozie | 4.3.0 | ||||
Pheonix | 4.9.0-HBase-1.1 | ||||
Pig | 0.15.0 | ||||
QFS | 1.1.4 | ||||
Solr | 4.10.4 | 6.6.0 | |||
Sqoop | 1.4.6 / 1.99.4 | ||||
Tajo | 0.11.1 | ||||
Tez | 0.6.2 | ||||
ycsb | 0.4.0 | ||||
Zeppelin | 0.7.0 |
Components compatibilties
Hadoop + HBase: http://hbase.apache.org/book.html#hadoop
Hadoop + Spark: https://issues.apache.org/jira/browse/SPARK-23534
Hadoop + Hive: Hadoop 3.0 + Hive 3.0.0; Hadoop 2.x + Hive 2.3.x
Hadoop + Oozie: https://issues.apache.org/jira/browse/OOZIE-2973
Hadoop + Pig: https://issues.apache.org/jira/browse/PIG-5253
Hadoop + Tez: https://issues.apache.org/jira/browse/TEZ-3923, https://issues.apache.org/jira/browse/TEZ-3252
Hadoop + Solr: https://issues.apache.org/jira/browse/SOLR-9515, https://issues.apache.org/jira/browse/SOLR-9761