Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hotfix: set worker ASG onDemandPercentageAboveBaseCapacity to 10 #85

Merged
merged 2 commits into from
Jun 18, 2024

Conversation

zekehuntergreen
Copy link
Contributor

What does this change?

Sets worker autoscaling group on-demand percentage to 10%

Why

On-demand percentage of the worker ASG is currently 0% so when there are no spot instances available in our AWS region, the ASG is unable to scale with the transcription job queue. This happened over the weekend resulting in a backlog of 14 jobs and a few failed transcriptions. We should keep on-demand percentage at > 0% until we find a way to use 100% spot instances, unless there are none available, in which case we fall back to on-demand instances.

How to test

Deployed to prod

@zekehuntergreen zekehuntergreen requested a review from a team as a code owner June 17, 2024 17:15
@zekehuntergreen zekehuntergreen merged commit 8e5bb1d into main Jun 18, 2024
3 checks passed
@zekehuntergreen zekehuntergreen deleted the hotfix-spot-instance-proportion branch June 18, 2024 15:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants