The Distributed Asynchronous Object Storage (DAOS) is an open-source software-defined object store designed from the ground up for massively distributed Non Volatile Memory (NVM). DAOS takes advantage of next generation NVM technology like Storage Class Memory (SCM) and NVM express (NVMe) while presenting a key-value storage interface and providing features such as transactional non-blocking I/O, advanced data protection with self-healing on top of commodity hardware, end-to-end data integrity, fine-grained data control and elastic storage to optimize performance and cost.

In the recently years, intel is taking a lot of efforts to promote the DAOS as its HPC storage solution for X86.

DAOS is typically well support the next stage of NVME and PMEM, which is leveraging the better SPDK and PMDK to handle the data plane, can achieve better benchmarking.

DAOS on Arm64 status: https://docs.daos.io/release/support_matrix/, no official release, no validate, some upstream developers do local manually test only.

PMDK for persist memory to hold the metadata, low latency IO& indexing

SPDK for NVME, hold the bulk data

Famous User cases:

• Traditional Modelling & Simulation

  • Direct integration of the domain-specific data models (e.g. oil & gas, meteorology, animation…) over the DAOS API to accelerate applications

• High-Performance Data Analytics (HPDA)

  • storage API with native support for unstructured and semi-structured data

  • DAOS stores small writes and metadata into byte-granular persistent memory

• Artificial Intelligence

  • AI workloads perform large volumes of reads - data access time becomes critical

  • DAOS provides low latency access to read the data compared to existing solutions

Ref

1. DAOS Github: https://github.com/daos-stack

2. IO 500 Ranking: 5 of the top 10 are using DAOS. https://io500.org/

3. DAOS performance vs Lustre: https://www.youtube.com/watch?v=NlKvx7dZ8C0

4. Tianhe supercomputing presentation of Lustre and DAOS: http://russianscdays.org/files/2020/pdf/keynote/RWang.pdf

5. https://docs.daos.io/

6. A good introduction of DAOS: https://www.alcf.anl.gov/sites/default/files/2020-03/2020-03 slide presentation DAOS.pdf

Deliverables

• DAOS function validation/Build and test on Arm64

• DAOS CI setup on Arm64

• DAOS optimization with Arm64 specified instruction

• DAOS performance benchmarking, comparison with other famous open source storage

Acceptance Criteria Example and Notes (Optional)