SPEC2017
Repository
https://dev-private-git.linaro.org/restricted-benchmarks/CPU2017.git/
Status
IntRate/FpRate with no_fortran can run on WOA with clang build.
Fortran test need to be support after flang is OK.
FpSpeed tests run failed on clang
Test case 526 clang result wrong need to be fixed, it looks x86 clang also failed on Windows.
Install
Clone the code from the repo.
Install.bat
Run
shrc.bat
download this 2 files and put them into config folder
3. ‘runcpu no_fortran -c clang-woa’ or ‘runcpu no_fortran -c msvc’
when we use clang to build, please make sure the clang version >= 15
clang 14 build failed on 523/623.
Compile Options
All compile options can be adjust in config file. It is in the config folder.
We can find the variable CXXOPTIMIZE/OPTIMIZE to modify the options.
Result
O0 Result:
| MSVC 19.33.31629 | O0 | Clang15 | O0 |
|
500.perlbench_r | 1158.876899 | 1.373744 | 1175.391681 | 1.354442 | -1.41% |
502.gcc_r | 876.47172 | 1.615568 | 874.259943 | 1.619656 | 0.25% |
505.mcf_r | 840.492653 | 1.922682 | 830.327836 | 1.946219 | 1.22% |
520.omnetpp_r | 1968.219366 | 0.666592 | 1941.018189 | 0.675934 | 1.40% |
523.xalancbmk_r | 1602.713984 | 0.658882 | 1670.802401 | 0.632032 | -4.08% |
525.x264_r | 2240.751749 | 0.781434 | 1599.872048 | 1.094463 | 40.06% |
531.deepsjeng_r | 945.577264 | 1.211958 | 858.81092 | 1.334403 | 10.10% |
541.leela_r | 2542.71477 | 0.651272 | 2407.003167 | 0.687992 | 5.64% |
548.exchange2_r |
|
|
|
|
|
557.xz_r | 1181.348912 | 0.914209 | 1099.669843 | 0.982113 | 7.43% |
|
|
|
|
|
|
SPECrate2017_int_base |
| 1.006158 |
| 1.067484 | 6.10% |
|
|
|
|
|
|
503.bwaves_r |
|
|
|
|
|
507.cactuBSSN_r |
|
|
|
|
|
508.namd_r | 1156.462228 | 0.821471 | 976.556179 | 0.972806 | 18.42% |
510.parest_r |
|
| 2897.094787 | 0.902974 |
|
511.povray_r | 1648.060358 | 1.416817 | 1689.090041 | 1.382401 | -2.43% |
519.lbm_r | 730.963926 | 1.441932 | 474.349233 | 2.221992 | 54.10% |
521.wrf_r |
|
|
|
|
|
526.blender_r | 1131.855406 | 1.345578 | 978.278377 | 1.556817 |
|
527.cam4_r |
|
|
|
|
|
538.imagick_r | 1447.23497 | 1.718449 | 1248.919507 | 1.991321 | 15.88% |
544.nab_r | 939.029472 | 1.792276 | 846.085775 | 1.98916 | 10.99% |
549.fotonik3d_r |
|
|
|
|
|
554.roms_r |
|
|
|
|
|
|
|
|
|
|
|
SPECrate2017_fp_base |
| 1.381604 |
| 1.49433 | 8.16% |
O1 result:
| MSVC 19.33.31629 | O1 | Clang15 | O1 |
|
500.perlbench_r | 577.058571 | 2.758819 | 572.917326 | 2.77876 | 0.72% |
502.gcc_r | 401.088755 | 3.530391 | 394.771672 | 3.586884 | 1.60% |
505.mcf_r | 436.545381 | 3.701792 | 471.227337 | 3.429343 | -7.36% |
520.omnetpp_r | 878.880531 | 1.492808 | 878.687742 | 1.493136 | 0.02% |
523.xalancbmk_r | 394.254187 | 2.678475 | 397.621992 | 2.655789 | -0.85% |
525.x264_r | 665.708082 | 2.630282 | 378.619068 | 4.624701 | 75.83% |
531.deepsjeng_r | 389.288872 | 2.943829 | 358.815106 | 3.193845 | 8.49% |
541.leela_r | 624.580502 | 2.65138 | 572.785861 | 2.891133 | 9.04% |
548.exchange2_r |
|
|
|
|
|
557.xz_r | 516.374698 | 2.091504 | 537.039062 | 2.011027 | -3.85% |
|
|
|
|
|
|
SPECrate2017_int_base |
| 2.63815 |
| 2.829912 | 7.27% |
|
|
|
|
|
|
503.bwaves_r |
|
|
|
|
|
507.cactuBSSN_r |
|
|
|
|
|
508.namd_r | 318.319754 | 2.984421 | 253.464223 | 3.748063 | 25.59% |
510.parest_r |
|
| 492.154462 | 5.315404 |
|
511.povray_r | 651.234819 | 3.585496 | 619.564597 | 3.768776 | 5.11% |
519.lbm_r | 293.301958 | 3.593566 | 236.65693 | 4.453704 | 23.94% |
521.wrf_r |
|
|
|
|
|
526.blender_r | 352.828239 | 4.316548 |
|
|
|
527.cam4_r |
|
|
|
|
|
538.imagick_r | 684.180401 | 3.635006 | 435.202322 | 5.714583 | 57.21% |
544.nab_r | 439.243907 | 3.831584 | 353.448188 | 4.76166 | 24.27% |
549.fotonik3d_r |
|
|
|
|
|
554.roms_r |
|
|
|
|
|
|
|
|
|
|
|
SPECrate2017_fp_base |
| 3.636296 |
| 4.569142 | 25.65% |
O2 Result:
| MSVC 19.32.31332 | O2 | Clang15 | O2 |
|
500.perlbench_r | 576.044764 | 2.763674 | 575.016 | 2.768619 | 0.18% |
502.gcc_r | 396.1704 | 3.57422 | 358.7408 | 3.94714 | 10.43% |
505.mcf_r | 418.292667 | 3.863324 | 451.4158 | 3.579848 | -7.34% |
520.omnetpp_r | 865.79064 | 1.515378 | 841.9755 | 1.55824 | 2.83% |
523.xalancbmk_r | 379.11616 | 2.785426 | 375.6941 | 2.810797 |
|
525.x264_r | 277.331383 | 6.313746 | 228.0843 | 7.676986 | 21.59% |
531.deepsjeng_r | 371.527691 | 3.084561 | 369.0513 | 3.105259 | 0.67% |
541.leela_r | 561.254361 | 2.950534 | 511.6378 | 3.236664 | 9.70% |
548.exchange2_r |
|
|
|
|
|
557.xz_r | 521.975216 | 2.069064 | 520.0159 | 2.07686 | 0.38% |
|
|
|
|
|
|
SPECrate2017_int_base |
| 2.990885 |
| 3.044995 | 1.81% |
|
|
|
|
|
|
503.bwaves_r |
|
|
|
|
|
507.cactuBSSN_r |
|
|
|
|
|
508.namd_r | 309.708155 | 3.067404 | 251.0972 | 3.783395 | 23.34% |
510.parest_r |
|
| 455.0611 | 5.748679 |
|
511.povray_r | 626.378121 | 3.72778 | 555.838 | 4.200864 | 12.69% |
519.lbm_r | 291.87014 | 3.611195 | 226.4897 | 4.653634 | 28.87% |
521.wrf_r |
|
|
|
|
|
526.blender_r | 330.498641 | 4.608188 |
|
|
|
527.cam4_r |
|
|
|
|
|
538.imagick_r | 528.213244 | 4.708326 | 419.4619 | 5.929024 | 25.93% |
544.nab_r | 428.472836 | 3.927904 | 351.0028 | 4.794834 | 22.07% |
549.fotonik3d_r |
|
|
|
|
|
554.roms_r |
|
|
|
|
|
|
|
|
|
|
|
SPECrate2017_fp_base |
| 3.900063 |
| 4.790596 | 22.83% |