Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add weekly build/test scripts #1213

Draft
wants to merge 150 commits into
base: develop
Choose a base branch
from

Conversation

AlexanderRichert-NOAA
Copy link
Collaborator

@AlexanderRichert-NOAA AlexanderRichert-NOAA commented Jul 30, 2024

Summary

This PR will add scripting for weekly unit testing and build caching of the unified env through Jenkins, cron jobs, etc.

Also a few updates for Acorn, including a change to spack stack create env --compiler that allows compiler version to be specified (spack stack create env --compiler intel -> envs/myenv-intel; spack stack create env --compiler intel@2022 -> envs/myenv-intel-2022), which is needed to differentiate on platforms platform where more than one version of a compiler is installed.

To-do list:

  • Set up script for running at least one UWM RT that runs s2swa (cpld_control_p8? should include MAPL, Scotch; see UWM testing in weekly builds #1303).
  • Figure out how best to track results so we don't get in the habit of ignoring failing unit tests (Slack integration?)

Testing/implementation by platform

On each system:

  • Configure ShellSetup.sh (including setting centralized build_cache dir under spack-stack/ dir)
  • Set up centralized source cache
  • Get it running (Jenkins, cron, GHA); test installing a few packages
  • Enable notifications (email, Slack, whatever)

Platforms (check when all of the above items are complete):

Applications affected

all

Systems affected

all (eventually)

Dependencies

none

Issue(s) addressed

#1184, #365

Checklist

  • This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
  • These changes have been tested on the affected systems and applications.
  • All dependency PRs/issues have been resolved and this PR can be merged.

@AlexanderRichert-NOAA
Copy link
Collaborator Author

closing temporarily so I don't spam the CI with jobs...

@AlexanderRichert-NOAA
Copy link
Collaborator Author

Cron entry for Acorn: 0 1 * * SUN /path/to/spack-stack-weekly-build/util/weekly_build/SpackStackBuildCache_AllSteps.sh $(date +\%y\%m\%d) /path/to/spack-stack/weekly_build acorn > /path/to/spack-stack/weekly_build/logs/cron.$(date +\%y\%m\%d).out 2>&1

@climbfuji
Copy link
Collaborator

@AlexanderRichert-NOAA I am pulling in the latest updates from develop once more

climbfuji and others added 19 commits October 22, 2024 08:56
…up.sh, and re-enable .github/workflows/nautilus-nightly-intel.yaml
TO BE DISCUSSED AT THE MEETING - Feature/weekly build nrl
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

6 participants