Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intermittent segmentation faults on Ubuntu 24.04 ARM, multiple Actions and binaries #11541

Open
2 of 15 tasks
bbasata opened this issue Feb 5, 2025 · 5 comments
Open
2 of 15 tasks

Comments

@bbasata
Copy link

bbasata commented Feb 5, 2025

Description

Original report: hashicorp/setup-terraform#459

I'm investigating this report of segmentation faults on hashicorp/setup-terraform runs on ubuntu-24.04-arm. So I constructed a test repo that was reliably reproducing a ~15% fault rate.

In recent runs of the test repo, I am now seeing errors in actions/checkout (exit code 139) that were not occurring before. On the surface, exit code 139 matches Docker's exit code for a segmentation fault.

Runner image provisioner, for successful and failed runs: 2.0.422.1

The test repo:

GitHub repo (arm branch): bbasata/setup-terraform-issue-459:arm
Workflow runs: https://github.com/bbasata/setup-terraform-issue-459/actions/workflows/terraform.yml

Platforms affected

  • Azure DevOps
  • GitHub Actions - Standard Runners
  • GitHub Actions - Larger Runners

Runner images affected

  • Ubuntu 20.04
  • Ubuntu 22.04
  • Ubuntu 24.04
  • macOS 13
  • macOS 13 Arm64
  • macOS 14
  • macOS 14 Arm64
  • macOS 15
  • macOS 15 Arm64
  • Windows Server 2019
  • Windows Server 2022
  • Windows Server 2025

Image version and build link

https://github.com/bbasata/setup-terraform-issue-459/actions/workflows/terraform.yml

Is it regression?

Yes

Expected behavior

Successful workflow runs

Actual behavior

Intermittent segmentation faults that fail the workflow run

Repro steps

  1. Fork https://github.com/bbasata/setup-terraform-issue-459
  2. Run the Terraform workflow with branch arm -- it runs 30 small jobs
  3. Expect all 30 jobs to succeed
@hemanthmanga
Copy link
Contributor

Hi @bbasata, Thank you for bringing this issue to our attention. We are looking into this issue and will update you on this issue after investigating.

@MikeMcC399
Copy link

I am seeing flaky behavior on ubuntu-24.04-arm

  • checkout fails (as reported here)
  • also 3154 Segmentation fault (core dumped) npm ci

Re-running the failing workflow will sometimes then run successfully.
https://www.githubstatus.com/ shows no outage at this time.

@tedchamb
Copy link

tedchamb commented Feb 5, 2025

Does anyone have a simple repro for this I can use to investigate?

@MikeMcC399
Copy link

MikeMcC399 commented Feb 5, 2025

@tedchamb

Does anyone have a simple repro for this I can use to investigate?

You can fork https://github.com/cypress-io/cypress-docker-images and run the workflow https://github.com/cypress-io/cypress-docker-images/actions/workflows/example-tests.yml manually.

The tests are randomly failing.

Thanks for looking at this! I don't really want to disable ubuntu-24.04-arm if I can help it, so it would be great to fix it!

@bbasata
Copy link
Author

bbasata commented Feb 5, 2025

Does anyone have a simple repro for this I can use to investigate?

See also the top post:

  1. Fork https://github.com/bbasata/setup-terraform-issue-459
  2. Run the Terraform workflow with branch arm -- it runs 30 small jobs
  3. Expect all 30 jobs to succeed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants