TestBase package creation tool for upstream LLVM release

Description

The goal of this task is to create a script utility that automates the process of downloading the upstream LLVM releases for Windows platforms (for both x64 and aarch64 architectures) and subsequently generates a test package zip file compatible with Microsoft Azure Test Base 365.

This test package will be utilised to evaluate the LLVM's compatibility across different versions of Windows operating systems using the Microsoft Test Base service.

Note:

Initial version of scripting utility is available on github in a private repository. Ping for access.

Important Information:

Objectives:

  • Script Development:

    • Develop two scripts: one Bash script for Linux-based environments and one PowerShell script for Windows-based environments. These scripts should handle:

      • Automated Download: The scripts must automatically fetch the specified LLVM releases for Windows x64 and aarch64 architectures from the official LLVM upstream repository.

  • Test Package Generation:

    • After downloading the LLVM releases, the scripts should package them into a format compatible with Microsoft Test Base. This includes:

      • Organizing the LLVM binaries and necessary dependencies into a structured directory layout.

      • Preparing any configuration files or metadata required by Microsoft Test Base for testing.

Out of Scope

Following tasks are out of scope of this card and will be implemented separately by WoA team:

  • Microsoft Test Base Integration: Outline the steps or automate the submission of the generated test package to Microsoft Test Base for conducting compatibility and performance tests across different Windows versions. Ensure the script includes:

    • Selection of appropriate Windows versions for testing.

    • Configuration of test parameters and submission details

Activity

Omair Javaid 
March 14, 2024 at 11:47 AM

Completed initial development and PoC. TestBase has been deprecated so this issue may not be relevant for future work.

Code can be found at https://gitlab.com/Linaro/windowsonarm/testbase-llvm

Done

Details

Assignee

Reporter

Start date

Original estimate

Time tracking

No time logged2w remaining

Fix versions

Priority

Checklist

Sentry

Created January 23, 2024 at 7:18 PM
Updated March 14, 2024 at 11:47 AM
Resolved March 14, 2024 at 11:47 AM