Sources

...

• Upstream: https://github.com/apache/arrow
• Master branch is used in this Wiki.
• Apache Arrow is a cross-language development platform. This wiki lists three mainly modules (C++, C_glib and python) build steps.  

Setup Environment

...

• Ubuntu 16.04 64bit for Arm64
• Dependcies: maven@v3.3.9,  python>=2.7, python-dev, g++ , cmake > 3.6.0
• JDK 8, 1.8.0_171

Build Steps

...

Apache Arrow C++ codebase

This directory contains the code and build system for the Arrow C++ libraries, as well as for the C++ libraries for Apache Parquet.

Install CPP dependencies

Arrow uses CMake as a build configuration system. Currently, it supports in-source and out-of-source builds with the latter one being preferred.

• A C++11-enabled compiler. On Linux, gcc 4.8 and higher should be sufficient.
• CMake
• Boost

...

# Get source
wget https://cmake.org/files/v3.13/cmake-3.13.0-rc2.tar.gz


# Build $ install
tar zxvf cmake-3.13.0-rc2.tar.gz
cd cmake-3.13.0-rc2
./bootstrap
make -j32
sudo make install

# Set env
export PATH=/usr/local/bin:$PATH

Build Arrow CPP

1. Simple debug build:

git clone https://github.com/apache/arrow.git
cd arrow/cpp
mkdir debug
cd debug
cmake ..
make unittest

2. Simple debug build:

git clone https://github.com/apache/arrow.git
cd arrow/cpp
mkdir release
cd release
cmake .. -DCMAKE_BUILD_TYPE=Release
make unittest 

...

cmake -DARROW_BUILD_BENCHMARKS=ON -DCMAKE_BUILD_TYPE=Release ..
make runbenchmark

Arrow GLib

...

Python library for Apache Arrow

This library provides a Python API for functionality provided by the Arrow C++ libraries, along with tools for Arrow integration and interoperability with pandas, NumPy, and other software in the Python ecosystem.

System Requirements

On Linux, for this guide, we recommend using 4.9, or clang 3.7 or higher. 

Install C_glib dependencies

...

Build Arrow python

1. Environment variables :

export ARROW_BUILD_TYPE=release
export ARROW_HOME=$(pwd)/dist
export PARQUET_HOME=$(pwd)/dist
export LD_LIBRARY_PATH=$(pwd)/dist/lib:$LD_LIBRARY_PATH                

...

mkdir arrow/cpp/build
pushd arrow/cpp/build

cmake -DCMAKE_BUILD_TYPE=$ARROW_BUILD_TYPE \
      -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
      -DARROW_PARQUET=on \
      -DARROW_PYTHON=on \
      -DARROW_PLASMA=on \
      -DARROW_BUILD_TESTS=OFF \
      ..
make -j4
make install

If you don't want to build and install the Plasma in-memory object store, you can omit the -DARROW_PLASMA=on flag.

3. Build pyarrow:

cd arrow/python
python setup.py build_ext --build-type=$ARROW_BUILD_TYPE \
       --with-parquet --with-plasma --inplace             

...