Documentation
- Ganesh Raju (Deactivated)
- Jun He (Deactivated)
BigData components
ODPI and Apache BigTop
Build
Building BigTop using Docker container
/wiki/spaces/BDTS/pages/20384022610
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi BigTop Hadoop Installation, setup and running]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPiHadoopMultinodeClusterSetup]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi_Setup_Config_Run]
[https://wiki.linaro.org/LEG/Engineering/BigData/ODPi_Setup_Config_Run/ODPi_BigTop_Building]
Install
ERP 16.12: Installing Hadoop 2.7.2, Spark 2.0 and Hive 2.0.1
Bigtop Sandbox with Hadoop, Spark, Hive, HBase for Aarch64
Tests
Smoke Tests
Integration Tests
ODPi Spec Tests
Issues and Resolutions
Apache Ambari
Build
Build Apache Ambari on AArch64
Build and Install Apache Ambari V2.6.1 on AArch64
[https://wiki.linaro.org/LEG/Engineering/BigData/horrible-jvm-debug-case-for-ed-ambari]
Install
Apache Ambari Install, Setup and Configuration
Apache Hadoop
Build
[https://wiki.linaro.org/LEG/Engineering/BigData/HadoopBuildInstallAndRunGuide]
[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopbuildrun]
Install
Apache Spark
Build
Spark 2.0 - Build, configure and Installation steps using Apache BigTop
[https://wiki.linaro.org/LEG/Engineering/BigData/SparkDependencyLibraries]
[https://wiki.linaro.org/LEG/Engineering/BigData/Building_Spark_1_6]
[https://wiki.linaro.org/LEG/Engineering/BigData/Building_Spark_With_BigTop]
[https://wiki.linaro.org/LEG/Engineering/BigData/Spark]
Install
Apache Hive
Build
[https://wiki.linaro.org/LEG/Engineering/BigData/Hive]
Install
Apache HBase
Build
Install
Apache Zookeeper
Build
Zookeeper Enablement on AAarch64
ELK - ElasticSearch, Kibana and Logstash
Build
Building ELK (ElasticSearch, LogStash and Kibana) on Aarch64
Install
Apache Kafka
H2O
[https://wiki.linaro.org/LEG/Engineering/BigData/H2OInstallAndRunGuide]
[https://wiki.linaro.org/LEG/Engineering/BigData/H2OScalingStudy]
[https://wiki.linaro.org/LEG/Engineering/BigData/SparklingWaterGuide]
Benchmarks
[http://openjdk.linaro.org/hadoop-terasort-benchmark-results]
[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopconfig]
[https://wiki.linaro.org/Internal/People/SteveCapper/hadoop-lca13]
[https://wiki.linaro.org/LEG/Engineering/BigData/ApacheBench]
HiBench [wiki] [Collaborate]
[https://wiki.linaro.org/LEG/Engineering/BigData/BigBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/HiveTestBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/SparkBench]
[https://wiki.linaro.org/LEG/Engineering/BigData/TPCxHS]
[https://wiki.linaro.org/LEG/Engineering/BigData/TPC-H]
Workloads
DataScience
Guidelines
[https://wiki.linaro.org/LEG/Engineering/BigData/HadoopTuningGuide]
Misc
NETLIB-JAVA AArch64 Natives support
[https://wiki.linaro.org/LEG/Engineering/BigData/MapReduceNotes ]
[https://wiki.linaro.org/LEG/Engineering/BigData/horrible-jvm-debug-case-for-ed-hadoop]
[[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopbuildrun?action=AttachFile&do=view&target=0001-Introduce-the-HyperCrc32C-Checksum-class.patch| PATCH 1/3 Introduce the HyperCrc32C Checksum class]]
[[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopbuildrun?action=AttachFile&do=view&target=0002-libhadoop-CRC-ARM-NEON-support.patch| PATCH 2/3 libhadoop: CRC: ARM NEON support]]
[[https://wiki.linaro.org/LEG/Engineering/BigData/hadoopbuildrun?action=AttachFile&do=view&target=0003-Modify-HyperCRC-to-target-NEON-routine.patch| PATCH 3/3 Modify HyperCRC to target NEON routine]]
[https://wiki.linaro.org/LEG/Engineering/BigData/Feasibility]
[https://wiki.linaro.org/LEG/Engineering/BigData/CRC32vsNonCRC32Study]
[https://wiki.linaro.org/LEG/Engineering/BigData/configuring-archiva-with-tomcat7]
[https://wiki.linaro.org/LEG/Engineering/BigData/horrible-jvm-debug-case-for-ed-hadoop]