Introduction

Apache Ambari Management Packs addresses this issue by decoupling Ambari's core functionality (cluster management and monitoring) from stack management and definition. An Apache Ambari Management Pack (Mpack) can bundle multiple service definitions, stack definitions, stack add-on service definitions, view definitions services so that releasing these artifacts don’t enforce an Apache Ambari release. This page is shown how to deploy HDFS and zookeeper with ODPI-mpack on x86.

Steps of Setup

Environment

 Ambari server: 10.169.40.254
 Ambari agent01: 10.169.41.211
 Ambari agent02: 10.169.41.218

Ambari cluster setup

 Ambari server: 10.169.40.254
 Ambari agent01: 10.169.41.211
 Ambari agent02: 10.169.41.218

Build Ambari

To build Ambari, a certain version number should be provided. This version number IS 5-DIGITS, not "4-digits" mentioned on Ambari's Wiki Page. The last digit may vary but the first 3 digits should be same as Ambari source version. In our case this is 2.7.3.

cd <ambari_root_dir>
mvn versions:set -DnewVersion=2.6.1.0.0
pushd ambari-metrics
mvn versions:set -DnewVersion=2.6.1.0.0
popd
mvn -B clean install package rpm:rpm -DskipTests -Dpython.ver="python >= 2.6" -Preplaceurl

Ambari Server will create following packages

RPM will be created under AMBARI_DIR/ambari-server/target/rpm/ambari-server/RPMS/.

Ambari Agent will create following packages

RPM will be created under AMBARI_DIR/ambari-agent/target/rpm/ambari-agent/RPMS/.

Ambari Metrics will create following packages

RPM will be created under AMBARI_DIR/ambari-metrics/ambari-metrics-timelineservice/target/rpm/ambari-metrics-collector/RPMS/noarch.

Run Ambari Server

First, install prequesties

yum install postgresql

Then install the Ambari Server RPM.

yum install ambari-server/target/rpm/ambari-server/RPMS/x86_64/ambari-server-*.rpm

Initialize Ambari Server:

ambari-server setup

During setup, you will be prompted for JDK env. Please select choice 3 (Custom JDK), then input path for JAVA_HOME, usually /usr/lib/jvm/jre.

Start up Ambari Server:

ambari-server start

To access Ambari, go to: http://10.169.40.254:8080

The initial username/password is admin/admin.

Run Ambari Agent

Install the Ambari Agent RPM.

yum install ambari-agent/target/rpm/ambari-agent/RPMS/aarch64/ambari-agent-2.2.0.0-1.x86_64.rpm

Then edit the location of Ambari Server in /etc/ambari-agent/conf/ambari-agent.ini by editing the hostname line.

Start Ambari Agent:

sudo ambari-agent start

ODPI-mapck build and installation

Patch is provided to make ODPi-mpack work.

cd <odpi mapck root>
mvn clean package -DskipTests

Patches

Restart Ambari Server/Agent

sudo ambari-server reset
sudo ambari-server setup
sudo ambari-server start

 sudo ambari-agent start

Setup local repo

Use wls-x86-hp04 for Repo host: http://10.169.41.95/x86_64/centos/7/

sudo apt install -y createrepo nginx
copy HDP rpms to <nginx_www_root>/<HDP_dir>
cd <HDP_dir> && createrepo .

Big Data & Data Science

Deploy Ambari ODPI-mpack for Bigtop