AI Theme



Welcome!

The Linaro AI Theme is comprised of 2 engineering projects

HPC/Server activities focus on training and inference. It is performance and functionality oriented activity to improve Arm based HPC/Server for a range of AI workloads. The underlying ML Frameworks and dependencies are built from source to verify compatibility across a diverse set of stack permutations. Development within novel AI approaches beyond ML are also considered.

Arm based Edge devices are used for inferencing or reinforced training. Edge has much in common with Arm Servers as many of the inference frameworks or the support libraries they depend on are in use on Arm based Edge devices. Beyond Cortex-A CPUs, hardware accelerators are common. Often improvements targeted for Arm Servers also benefit Arm Edge devices. While Linaro does not develop hardware acceleration, frameworks and libraries need to be designed and optimized with Arm devices and offload in mind for peak efficiency and performance.

Last are activities focused on Microcontrollers, Cortex-M and Cortex-A devices with minimal capacities. With minimal RAM, storage and CPU, inference workloads must not only fit into a small space but frameworks must also be purpose optimized for the environment. µTVM and Tensorflow Lite Micro both are rapidly being developed to bring AI workloads on Microcontrollers. Collaborative activities across Linaro members are transforming these projects from early prototypes to productive environments for creating solutions optimized for Arm Microcontrollers.  

Page Owners:  Tom Gall 

Mail lists:

Related Web pages: