BigData components
- Mikael Rolfhamre
Apache Bigtop
Build
Building BigTop using Docker container
Building Hadoop 2.7.2, Spark 2.0, Hive 2.0.1 using Apache BigTop
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi BigTop Hadoop Installation, setup and running]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPiHadoopMultinodeClusterSetup]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi_Setup_Config_Run]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi_Setup_Config_Run/ODPi_BigTop_Building]
Install
ERP 16.12: Installing Hadoop 2.7.2, Spark 2.0 and Hive 2.0.1
Bigtop Sandbox with Hadoop, Spark, Hive, HBase for Aarch64
Tests
Smoke Tests
Integration Tests
ODPi Spec Tests
Apache Ambari
Build
Build Apache Ambari on AArch64
Build and Install Apache Ambari V2.6.1 on AArch64
[https://wiki.linaro.org/LEG/Engineering/BigData/horrible-jvm-debug-case-for-ed-ambari]
Install
Apache Ambari Install, Setup and Configuration
Apache Hadoop
Build
[https://wiki.linaro.org/LEG/Engineering/BigData/HadoopBuildInstallAndRunGuide]
[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopbuildrun]
Install
Apache Spark
Build
Spark 2.0 - Build, configure and Installation steps using Apache BigTop
[https://wiki.linaro.org/LEG/Engineering/BigData/SparkDependencyLibraries]
[https://wiki.linaro.org/LEG/Engineering/BigData/Building_Spark_1_6]
[https://wiki.linaro.org/LEG/Engineering/BigData/Building_Spark_With_BigTop]
[https://wiki.linaro.org/LEG/Engineering/BigData/Spark]
Install
Apache Hive
Build
[https://wiki.linaro.org/LEG/Engineering/BigData/Hive]
Install
Apache HBase
Build
Install
Apache Zookeeper
Build
Zookeeper Enablement on AAarch64
ELK - ElasticSearch, Kibana and Logstash
Build
Building ELK (ElasticSearch, LogStash and Kibana) on Aarch64
Install
Apache Kafka
H2O
[https://wiki.linaro.org/LEG/Engineering/BigData/H2OInstallAndRunGuide]
[https://wiki.linaro.org/LEG/Engineering/BigData/H2OScalingStudy]
[https://wiki.linaro.org/LEG/Engineering/BigData/SparklingWaterGuide]
Benchmarking
[http://openjdk.linaro.org/hadoop-terasort-benchmark-results]
[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopconfig]
[https://wiki.linaro.org/Internal/People/SteveCapper/hadoop-lca13]
[https://wiki.linaro.org/LEG/Engineering/BigData/ApacheBench]
HiBench [wiki] [Collaborate]
[https://wiki.linaro.org/LEG/Engineering/BigData/BigBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/HiveTestBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/SparkBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/TPCxHS]
[https://wiki.linaro.org/LEG/Engineering/BigData/TPC-H]