All work
- Lustre Arm64 CI maintenanceSTOR-252Xinliang Liu
- LU-17417 modproe libcfs oops (Rocky 9.3 aarch64 + 64k kernel + Lustre 2.15.4 client + 2.12.9 server)STOR-251Resolved issue: STOR-251Xinliang Liu
- LU-17397:mdtest failed (Lustre became read-only) under high stress (CentOS-8.5.2111 + Lustre 2.15.3)STOR-250Resolved issue: STOR-250Xinliang Liu
- Investigate Lustre IB configuration for multi-subnetsSTOR-249Resolved issue: STOR-249Xinliang Liu
- DAOS build on openEuler 22.03 LTSSTOR-248Resolved issue: STOR-248Kevin Zhao
- Lustre Performance Test Plan and Test Environment set upSTOR-247Resolved issue: STOR-247Xinliang Liu
- Lustre Performance Testing on openEulerSTOR-246Resolved issue: STOR-246Xinliang Liu
- Write Lustre user docs for openEuler 22.03 LTS SP3STOR-245Resolved issue: STOR-245Xinliang Liu
- openEuler 22.03 SP3 Lustre testSTOR-244Resolved issue: STOR-244Xinliang Liu
- Investigate and verify fscrypt on Kunpeng machineSTOR-243Xinliang Liu
- Lustre Community Activity StatisticsSTOR-242Resolved issue: STOR-242Xinliang Liu
- ZNS: NVME 2.0 ZNS Support/Optimization on Arm64STOR-241
- Lustre Cache: Persistent Client Cache and Metadata Write Back Cache on Arm64STOR-239
- Lustre Erasure Coding and Performance Optimization on Arm64STOR-238
- Lustre Compression and Encryption Enhancement on Arm64STOR-237Xinliang Liu
- fix ldiskfs build on new kernel kernel-5.10.0-153.27.0.103 oe22.03STOR-236Resolved issue: STOR-236Xinliang Liu
- Lustre sever rpm for openEuler 22.03 LTS SP3STOR-235Resolved issue: STOR-235Xinliang Liu
- [Lustre] v2.15 and master sanity test 398k,398l,398m failed on kernel 5.10STOR-234Resolved issue: STOR-234Xinliang Liu
- Fix Lustre build on openEuler 20.03 kernel 4.19STOR-233Resolved issue: STOR-233Xinliang Liu
- setup Lustre arm CI for openEuler 20.03 kernel 4.19STOR-232Resolved issue: STOR-232Xinliang Liu
- add support for openEuler derived OSesSTOR-231Resolved issue: STOR-231Xinliang Liu
- Fix Lustre target build on openEuler kernel 4.19STOR-230Resolved issue: STOR-230Xinliang Liu
- ldiskfs support for openEuler kernel 4.19STOR-229Xinliang Liu
- Lustre on openEuler 20.03 kernel 4.19STOR-228Resolved issue: STOR-228Xinliang Liu
- [Lustre] v2.15 need to backport credit patch for kernel 5.10+STOR-227Resolved issue: STOR-227Xinliang Liu
- [Lustre] recover-small test 136 stuck on kernel 5.10STOR-226Xinliang Liu
- [Lustre] add server support for openEuler 22.03 LTS SP2STOR-225Resolved issue: STOR-225Xinliang Liu
- [Lustre] dnf update failed after install lustre e2fsprogsSTOR-224Resolved issue: STOR-224Xinliang Liu
- Lustre filesystem check test bugfix on kernel 5.10STOR-223Resolved issue: STOR-223Xinliang Liu
- [Lustre] test runtests failed on openEuler 22.03STOR-222Resolved issue: STOR-222Xinliang Liu
- Identify the currently SPDK CI jobs on Arm64STOR-221Resolved issue: STOR-221Kevin Zhao
- SPDK Arm64 CI EnhancementSTOR-220Xinliang Liu
- Lustre Server 2.15 + kernel 5.10 CI Job SetupSTOR-219Resolved issue: STOR-219Xinliang Liu
- Lustre Server Kernel 5.10 CI job setup and misc tests BugfixSTOR-218Resolved issue: STOR-218Xinliang Liu
- Lustre sanity-lfsck bugfix on kernel 5.10STOR-217Resolved issue: STOR-217Xinliang Liu
- Lustre sanity-scrub test 2 failed on kernel 5.10STOR-216Resolved issue: STOR-216
- [Lustre] Sanity-sec test 26 crash on kernel 5.10STOR-215
- [Lustre] racer test suite stucks on kernel 5.10STOR-214Resolved issue: STOR-214Xinliang Liu
- [Lustre] Setup Lustre master CI for openEuler 22.03STOR-213Resolved issue: STOR-213Xinliang Liu
- [Lustre] 2.15 sanity tests 130a,130b,130c,130d,130e,130g failed on kernel 5.10STOR-212Resolved issue: STOR-212
- Change the Lustre test pipeline to 4K page sizeSTOR-211Resolved issue: STOR-211Xinliang Liu
- build Lustre and dependent pkgs for 4K page sizeSTOR-210Resolved issue: STOR-210Xinliang Liu
- [Lustre] 2.15 sanity test 101j,133a,133b,230t,904 failed on kernel 5.10STOR-209Resolved issue: STOR-209Xinliang Liu
- White paper description for Lustre Arm64 Client introduced on OpenEuler 22.03 LTS SP2STOR-208Resolved issue: STOR-208Xinliang Liu
- Add 3 THX2 to OpenStack ClusterSTOR-207Resolved issue: STOR-207Kevin Zhao
- Configure 3 THX2 Machines for Openstack Cluster for Lustre 4K CI usageSTOR-206Resolved issue: STOR-206Kevin Zhao
- [Lustre] openEuler-22.03-LTS-SP2 round-2 (Beta) testSTOR-205Resolved issue: STOR-205Xinliang Liu
- [Lustre] prepare openEuler 22.03 OpenStack VM imageSTOR-204Resolved issue: STOR-204Xinliang Liu
- [Lustre] openEuler 22.03 LTS SP2 Lustre client test reportSTOR-203Resolved issue: STOR-203Xinliang Liu
- [Lustre] add server support for openEuler 22.03 LTS SP1STOR-202Resolved issue: STOR-202Xinliang Liu
- Lustre Client RPM on OpenEuler 22.03 SP2 LTSSTOR-201Resolved issue: STOR-201Xinliang Liu
- DAOS openEuler Support on Arm64 PlatformSTOR-200Kevin Zhao
- DAOS Arm64 CI: NLT Full Functional TestsSTOR-199
- [DAOS] Dfuse Refine by Leveraging Linux Interception LibrarySTOR-198
- linux capstone hook PC relative support on Arm64STOR-197Kevin Zhao
- Lustre Arm64 CI: Switch to the 4K Page size Arm64 CI EnvironmentSTOR-196Resolved issue: STOR-196Xinliang Liu
- Lustre Client RPM on openEulerSTOR-195Resolved issue: STOR-195Xinliang Liu
- Support build Ceph on openEuler 22.03 LTSSTOR-194Resolved issue: STOR-194Kevin Zhao
- [Lustre] Add client support for openEuler master 6.1 kernelSTOR-193Resolved issue: STOR-193Xinliang Liu
- [Lustre] openEuler kernel 6.1 configure test compile error on CONFIG_KEYSSTOR-192Resolved issue: STOR-192Xinliang Liu
- [Lustre] kmod rpms install failed with "nothing provides kernel(xx)"STOR-191Resolved issue: STOR-191Xinliang Liu
- DAOS: New function interception library support on Arm64STOR-190Kevin Zhao
- [lustre] backport zfs openEuler support patches to stable release branchSTOR-189Resolved issue: STOR-189Xinliang Liu
- [Folly] Folly Checksum Optimization on Arm64STOR-188
- Cachebench Slow throughout on Arm64STOR-187
- [Lustre] [kernel 5.10] ldiskfs_find_dest_de bad entry in directorySTOR-186Resolved issue: STOR-186Xinliang Liu
- Cachelib Chained items test cases core dumpSTOR-185Kevin Zhao
- Cachelib Functional InvestigationSTOR-184Resolved issue: STOR-184Kevin Zhao
- Cachelib support on Arm64STOR-183Qinfei Liu
- Lustre on Arm64 Client Deploy Support for SJTU HPC test clusterSTOR-182Resolved issue: STOR-182Xinliang Liu
- Ceph Clang Build Issue TrackingSTOR-181Resolved issue: STOR-181Kevin Zhao
- [Lustre] Build zfs rpm pkgs on openEuler OBS master branchSTOR-180Resolved issue: STOR-180Xinliang Liu
- [Lustre] Build e2fsprogs rpm pkgs on openEuler OBS master branchSTOR-179Resolved issue: STOR-179Xinliang Liu
- CacheLib Performance TestingSTOR-178Kevin Zhao
- Ceph Arm64 CI: unittest-transaction-manager failed fixSTOR-177Resolved issue: STOR-177Rixin Luo
- Ceph Arm64 CI: unittest_mempool test failed fixSTOR-175
- [Lustre] Add openZFS rpm build support for openEulerSTOR-174Resolved issue: STOR-174Xinliang Liu
- OpenZFS Raidz Test on Arm64STOR-173
- OpenZFS Raidz Neon OptimizationSTOR-172Kevin Zhao
- Lustre: Use MPIIO to execute the IO500 TestSTOR-171Resolved issue: STOR-171Chunsong Feng
- [Lustre] Add Lustre e2fsprogs rpm build support for openEulerSTOR-170Resolved issue: STOR-170Xinliang Liu
- [Lustre] Do performance test on openEulerSTOR-169Resolved issue: STOR-169Chunsong Feng
- [Lustre] Do functional test on openEulerSTOR-168Resolved issue: STOR-168Chunsong Feng
- [Lustre] Add Lustre server support for openEulerSTOR-167Resolved issue: STOR-167Xinliang Liu
- [Lustre] Build Lustre client rpm on openEuler OBS master branchSTOR-166Resolved issue: STOR-166Xinliang Liu
- [Lustre] Add Lustre client support for openEulerSTOR-165Resolved issue: STOR-165Xinliang Liu
- Lustre IO500 Test: NULL pointer at lod_lookup+0x24/0x38STOR-164Xinliang Liu
- OpenZFS Checksum optimization on Arm64 - fletcher4STOR-163Kevin Zhao
- OpenZFS Performance OptimizationSTOR-160
- Lustre Server RPM support on openEuler LTS 22.03STOR-159Resolved issue: STOR-159Xinliang Liu
- Lustre IO500 Test - Client soft lock up analysis when destroy the test environment and test filesSTOR-157Resolved issue: STOR-157Chunsong Feng
- SPDK patch check_format.sh script doesn't support aarch64STOR-156Xinliang Liu
- Verify Mayastor on openEulerSTOR-155Resolved issue: STOR-155Xinliang Liu
- Add SPDK support for openEulerSTOR-154Resolved issue: STOR-154Xinliang Liu
- fix mayastor build with latest DPDKSTOR-153Resolved issue: STOR-153Xinliang Liu
- Lustre IO500 Test - OSD osd_init_iobuf()) ASSERTION( iobuf->dr_elapsed_valid == 0 )STOR-152Chunsong Feng
- Lustre IO500 Test - ZFS backend OOM kill FixSTOR-151Resolved issue: STOR-151Kevin Zhao
- Slow test analysis - IO500 ior-hard test on LustreSTOR-149Resolved issue: STOR-149Chunsong Feng
- SPDK NVMe-oF TCP kernel initiator FIO test fails when io_engine=io_uringSTOR-148Resolved issue: STOR-148Xinliang Liu
- SPDK NVMe-oF TCP initiator gets stuck when running FIO testSTOR-147Resolved issue: STOR-147Xinliang Liu
- sanity test crash when booting.STOR-146Resolved issue: STOR-146
- Lustre Sanity test 156 bug fixSTOR-145Resolved issue: STOR-145
- Lustre sanity 151 Bug fixSTOR-144Resolved issue: STOR-144
- Lustre Sanity 150f FixSTOR-143Resolved issue: STOR-143
- Lustre Performance Cluster Setup - IO500 TestSTOR-142Resolved issue: STOR-142Chunsong Feng
- SPDK NVMe-oF RDMA functionality verification, performance test and optimizationSTOR-141Resolved issue: STOR-141
- SPDK NVMe-oF TCP functionality verification, performance test and optimizationSTOR-140Resolved issue: STOR-140Xinliang Liu
- SPDK NVMe user space driver functionality verification and performance testSTOR-139Resolved issue: STOR-139Xinliang Liu
- SPDK functionality verification, performance test and optimizationSTOR-138Resolved issue: STOR-138Xinliang Liu
- Lustre conf-sanity 112 failure fixSTOR-137Resolved issue: STOR-137Kevin Zhao
- Lustre conf-sanity 102 failure fixSTOR-136Resolved issue: STOR-136Kevin Zhao
- Lustre Sanity 133a fixSTOR-135Resolved issue: STOR-135
- Lustre Sanity test 118c, 118d fixSTOR-134Resolved issue: STOR-134Kevin Zhao
- Lustre Sanity test 155e,155f,155g,155h fixSTOR-133Resolved issue: STOR-133Kevin Zhao
- Lustre Sanity 56xc bugfixSTOR-132Resolved issue: STOR-132Kevin Zhao
- Lustre Sanity and SanityN test suite bugfix on Kernel 5.10STOR-130Resolved issue: STOR-130Xinliang Liu
- RocksDB bottleneck analysis and optimization on Arm64STOR-129Resolved issue: STOR-129
- Mayastor Performance Test and Optimization on Arm64STOR-128Resolved issue: STOR-128Xinliang Liu
- DAOS Arm64 Upstream CISTOR-127Resolved issue: STOR-127Kevin Zhao
- Lustre replay-dual 25 failing case fixSTOR-126Resolved issue: STOR-126Kevin Zhao
- Lustre Recovery Function Validation and Test suite bugfixSTOR-125Resolved issue: STOR-125
- Lustre components and performance test bugfixSTOR-124Resolved issue: STOR-124
- Lustre Sanity Test Support and Bugfix on Arm64STOR-123Resolved issue: STOR-123Xinliang Liu
- Lustre Advance Features Function Validation and Test Failure FixSTOR-122Resolved issue: STOR-122
- Lustre Cluster Configuration: Conf-sanity Test failing case bugfixSTOR-121Resolved issue: STOR-121
- Lustre Conf-sanity test 98 fixSTOR-120Resolved issue: STOR-120Kevin Zhao
- Lustre parallel-scale-nfsv4 failure cases test fixSTOR-119
- Lustre sanity-scrub test 9 failed on kernel 5.10STOR-118
- Lustre performance-sanity failure cases test fixSTOR-117
- Lustre sanity-benchmark failure cases test fixSTOR-116Resolved issue: STOR-116
- Lustre lnet-selftest failure cases test fixSTOR-115Resolved issue: STOR-115
- Lustre sanity-quota failure cases test fixSTOR-114
- Lustre large-scale failure cases test fixSTOR-113
- Lustre pjdfstest failure cases test fixSTOR-112Resolved issue: STOR-112Xinliang Liu
- RocksDB deployment and performance test on Arm64STOR-111Resolved issue: STOR-111
- Lustre Multiple nodes deployment with RDMA supports on Arm64STOR-110Resolved issue: STOR-110
- DAOS Unit Test CI support on Arm64STOR-109Resolved issue: STOR-109
- DAOS External Builder Support - RPM basedSTOR-108Resolved issue: STOR-108Kevin Zhao
- Remove the dependency IPMCTL from DAOSSTOR-107Resolved issue: STOR-107Chunsong Feng
- DAOS Arm64 External Builder Support - DebSTOR-106Resolved issue: STOR-106Kevin Zhao
- RocksDB Performance Test and Optimization on Aarch64STOR-105Resolved issue: STOR-105
- mayastor control plane v2.0 validation and enablement on Arm64STOR-104Resolved issue: STOR-104Xinliang Liu
- Lustre sanity sec nodemap ops failed on Arm64STOR-103Kevin Zhao
- Lustre client-side encryption function verification and investigationSTOR-102Resolved issue: STOR-102Kevin Zhao
- directory delete fails on multiple MDSSTOR-101Resolved issue: STOR-101Xinliang Liu
- Setup Lustre Arm64 RPM repositorySTOR-100Resolved issue: STOR-100Xinliang Liu
- Lustre Bug: IO write gets stuck on some test sanityn cases for 64K PAGE_SIZESTOR-99Resolved issue: STOR-99Xinliang Liu
- BeeGFS Performance Test on Arm64STOR-98Resolved issue: STOR-98Qinfei Liu
- SPDK nof performance optimizationSTOR-97Resolved issue: STOR-97Chunsong Feng
- Support Lustre Gerrit Optional CI Job on Arm64STOR-96Resolved issue: STOR-96
Finished loading more work items at the bottom of the list.
150 of 283
Lustre Arm64 CI: Switch to the 4K Page size Arm64 CI Environment
Done
Description
100% Done
Details
Details
Assignee
Xinliang Liu
Xinliang LiuReporter
Kevin Zhao
Kevin ZhaoOriginal estimate
4w
Time tracking
No time logged4w remaining
Fix versions
Priority
Epic Name
Lustre Arm64 CI: Setup the 4K Pagesize Arm64 CI Environment
Checklist
Checklist
Sentry
Sentry
Created April 10, 2023 at 1:43 PM
Updated July 5, 2023 at 3:28 AM
Resolved July 5, 2023 at 3:28 AM
Activity
Show:
Kevin Zhao May 22, 2023 at 8:21 AM
TODO: Add to openstack cluster
Kevin Zhao May 22, 2023 at 8:20 AM
tx215/rack3-thx2-03 | j13-switch-01 24 | 1T 400G nvme 480G ssd | 10.101.100.42 |
| 10.41.24.155 |
tx214/rack3-thx2-04 | j13-switch-01 23 | 1T 480G | 10.40.88.183 |
| 10.41.24.154 |
tx213/rack3-thx2-05 | j13-switch-01 22 | 480G ssd | 10.40.88.184 |
| 10.41.24.153 |
Xinliang Liu May 22, 2023 at 4:35 AM
Maybe switch to test openEuler 22.03 LTS which is 4K page size.
More and more operation system now are changing its pagesize to 4K on Arm64. The Centos 9 now by default pagesize is 4K, while the default page size on Centos 8 is 64K previously. For 64K pagesize, even at some time it can achieve some performance benefits, the most challenges for the software developers and users are all the upper level software should adopt the new page size, which induce a heavy software modification.
Starting from Centos 9 stream, the default page size is 4K. Besides, the default page size for Debian/Ubuntu and OpenEuler are also 4K.
For Lustre, it is a kernel mode file system and it has been already done several code change to suitable for the page size compatibility, and the 64K page size is usually induces some bugs when we play with Lustre. From the development and production perceptive, now we can see that bind with 4K should be enough, and it will reduce more effort for page size compatibility and doing more work for performance optimization on Arm64.