Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

use TARGET=ARMV8 when building OpenBLAS for aarch64/generic #793

Merged
merged 2 commits into from
Oct 18, 2024
Merged

use TARGET=ARMV8 when building OpenBLAS for aarch64/generic #793

merged 2 commits into from
Oct 18, 2024

Conversation

boegel
Copy link
Contributor

@boegel boegel commented Oct 17, 2024

No description provided.

@boegel boegel added aarch64 related to Arm 64-bit targets (aarch64) 2023.06-software.eessi.io 2023.06 version of software.eessi.io labels Oct 17, 2024
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

@eessi-build-deploy-bot-deucalion EESSI build-deploy bot @ Deucalion
Copy link

Instance boegel-bot-deucalion is configured to build for:

  • architectures: aarch64/a64fx
  • repositories: eessi.io-2023.06-software

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi.io-2023.06-compat

@boegel
Copy link
Contributor Author

boegel commented Oct 17, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic

@eessi-build-deploy-bot-deucalion EESSI build-deploy bot @ Deucalion
Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance boegel-bot-deucalion (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

New job on instance eessi-bot-mc-aws for CPU micro-architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_793/23809

date job status comment
Oct 17 17:45:05 UTC 2024 submitted job id 23809 awaits release by job manager
Oct 17 17:45:22 UTC 2024 released job awaits launch by Slurm scheduler
Oct 17 17:51:24 UTC 2024 running job 23809 is running
Oct 17 18:53:01 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-23809.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1729190399.tar.gzsize: 57 MiB (59816877 bytes)
entries: 144
modules under 2023.06/software/linux/aarch64/generic/modules/all
OpenBLAS/0.3.21-GCC-12.2.0.lua
OpenBLAS/0.3.23-GCC-12.3.0.lua
OpenBLAS/0.3.24-GCC-13.2.0.lua
software under 2023.06/software/linux/aarch64/generic/software
OpenBLAS/0.3.21-GCC-12.2.0
OpenBLAS/0.3.23-GCC-12.3.0
OpenBLAS/0.3.24-GCC-13.2.0
other under 2023.06/software/linux/aarch64/generic
2023.06/init/easybuild/eb_hooks.py
Oct 17 18:53:01 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:aarch64-generic-node+default
P: perf: 669.708 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:aarch64-generic-node+default
P: perf: 700.662 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:aarch64-generic-node+default
P: latency: 3.55 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:aarch64-generic-node+default
P: latency: 3.78 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:aarch64-generic-node+default
P: latency: 5.41 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:aarch64-generic-node+default
P: latency: 5.54 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:aarch64-generic-node+default
P: latency: 0.46 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:aarch64-generic-node+default
P: latency: 0.47 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:aarch64-generic-node+default
P: bandwidth: 19648.18 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:aarch64-generic-node+default
P: bandwidth: 19746.88 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-23809.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@boegel
Copy link
Contributor Author

boegel commented Oct 17, 2024 •
edited
Loading

Hmm, check for missing installations is reporting this for all CPU targets:

* jedi/0.19.0-GCCcore-12.3.0 (jedi-0.19.0-GCCcore-12.3.0.eb)

How did that happen? 🤔

edit: related to easybuilders/easybuild-easyconfigs#21686, fixing in #794

@boegel
Copy link
Contributor Author

boegel commented Oct 17, 2024 •
edited
Loading

This is actually a great opportunity to strip out pre_configure_hook_openblas_optarch_generic and implement it in the OpenBLAS easyblock in EasyBuild instead...

edit:

@boegel
use updated OpenBLAS easyblock that sets DYNAMIC_ARCH=1 for generic b…
188938a 
…uilds + uses TARGET=ARMV8 for aarch64/generic
@boegel boegel marked this pull request as ready for review October 17, 2024 19:30
@boegel
Copy link
Contributor Author

boegel commented Oct 17, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

@eessi-build-deploy-bot-deucalion EESSI build-deploy bot @ Deucalion
Copy link

eessi-build-deploy-bot-deucalion bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance boegel-bot-deucalion (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

Updates by the bot instance eessi-bot-mc-azure (click for details)

  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic

  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

    • no jobs were submitted

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 17, 2024 •
edited
Loading

New job on instance eessi-bot-mc-aws for CPU micro-architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_793/23821

date job status comment
Oct 17 19:30:32 UTC 2024 submitted job id 23821 awaits release by job manager
Oct 17 19:31:25 UTC 2024 released job awaits launch by Slurm scheduler
Oct 17 19:32:27 UTC 2024 running job 23821 is running
Oct 17 20:33:29 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-23821.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1729196442.tar.gzsize: 57 MiB (59822544 bytes)
entries: 144
modules under 2023.06/software/linux/aarch64/generic/modules/all
OpenBLAS/0.3.21-GCC-12.2.0.lua
OpenBLAS/0.3.23-GCC-12.3.0.lua
OpenBLAS/0.3.24-GCC-13.2.0.lua
software under 2023.06/software/linux/aarch64/generic/software
OpenBLAS/0.3.21-GCC-12.2.0
OpenBLAS/0.3.23-GCC-12.3.0
OpenBLAS/0.3.24-GCC-13.2.0
other under 2023.06/software/linux/aarch64/generic
2023.06/init/easybuild/eb_hooks.py
Oct 17 20:33:29 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:aarch64-generic-node+default
P: perf: 696.071 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:aarch64-generic-node+default
P: perf: 698.891 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:aarch64-generic-node+default
P: latency: 3.46 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:aarch64-generic-node+default
P: latency: 3.42 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:aarch64-generic-node+default
P: latency: 5.57 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:aarch64-generic-node+default
P: latency: 5.38 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:aarch64-generic-node+default
P: latency: 0.47 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:aarch64-generic-node+default
P: latency: 0.44 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:aarch64-generic-node+default
P: bandwidth: 19529.52 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:aarch64-generic-node+default
P: bandwidth: 19781.82 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-23821.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Oct 18 07:28:21 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1729196442.tar.gz to S3 bucket succeeded

@boegel boegel added the ready-to-deploy Mark a PR as ready to deploy label Oct 17, 2024
@bedroge bedroge mentioned this pull request Oct 17, 2024
Merged
@boegel
Copy link
Contributor Author

boegel commented Oct 18, 2024

@bedroge Should be OK to trigger deployment for this one too?

The x86_64/generic builds are unaffected, no need to rebuild those, this is purely for aarch64/generic

@bedroge bedroge added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels Oct 18, 2024
@eessi-build-deploy-bot-deucalion EESSI build-deploy bot @ Deucalion
Copy link

Label bot:deploy has been set by user bedroge, but this person does not have permission to trigger deployments

@bedroge
Copy link
Collaborator

bedroge commented Oct 18, 2024

Manual ingestion procedure:

rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/OpenBLAS/0.3.21-GCC-12.2.0/
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/OpenBLAS/0.3.23-GCC-12.3.0/
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/OpenBLAS/0.3.24-GCC-13.2.0/

cd /cvmfs/software.eessi.io/versions

tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-aarch64-generic-1729196442.tar.gz

@bedroge
Copy link
Collaborator

bedroge commented Oct 18, 2024

I've manually removed the existing installations and ingested the tarball (and also merged the staging PR, which will basically ingest/replace them again).

@bedroge bedroge merged commit 339a71e into EESSI:2023.06-software.eessi.io Oct 18, 2024
50 checks passed
@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 18, 2024

PR merged! Moved ['/project/def-users/SHARED/jobs/2024.10/pr_793/23809', '/project/def-users/SHARED/jobs/2024.10/pr_793/23821'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.18

@eessi-bot eessi-bot
Copy link

eessi-bot bot commented Oct 18, 2024

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.18

@eessi-build-deploy-bot-deucalion EESSI build-deploy bot @ Deucalion
Copy link

PR merged! Moved [] to /home/kehoste/project_dir/bot/trash-bin #$HOME/trash_bin/EESSI/software-layer/2024.10.18

@boegel boegel deleted the 2023.06-software.eessi.io_rebuild_OpenBLAS_aarch64-generic branch October 19, 2024 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bedroge bedroge bedroge approved these changes

Assignees
No one assigned
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io aarch64 related to Arm 64-bit targets (aarch64) bot:deploy Ask bot to deploy missing software installations to EESSI
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@boegel @bedroge