Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

snapshotengine: move sleep to reduce volumes #598

Merged
merged 2 commits into from
Sep 6, 2023

Conversation

orcutt989
Copy link
Contributor

@orcutt989 orcutt989 commented Aug 25, 2023

Currently the artifact job sleeps a user-defined amount of time to reduce frequency of artifact creation. This resulted in PVCs remaining bound to the kubernetes nodes. With the migration to Digital Ocean a new limit was encountered- only 7 volumes allowed per droplet(node) which was resulting in a need for more droplets.

This PR moves moves the sleep out of the artifact creation job causing it to terminate. The maker job detects this, deletes the job and PVCs and sleeps instead freeing up slots.

Additional info- AWS volume-per-instance limit was at minimum 32 so this was not an issue, but is now on Digital Ocean because of the 7 volume limit per droplet. The volume-per-droplet limit is hard platform limit and not changeable by Digital Ocean support.

@orcutt989
Copy link
Contributor Author

Setup QEMU is failing so I opened a ticket docker/setup-qemu-action#94

Looks like something is wrong with one of the images it uses.

@nicolasochem nicolasochem self-requested a review September 6, 2023 17:20
Copy link
Collaborator

@nicolasochem nicolasochem left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks. This has been deployed for a couple of weeks and appears to be working as expected.

@orcutt989 orcutt989 merged commit 9424957 into master Sep 6, 2023
20 checks passed
@orcutt989 orcutt989 deleted the move-sleep-to-reduce-volumes branch September 21, 2023 19:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants