Skip to content

e2e: Re-enable and fix flaky pipelinerun-with-matrix example test #9201

@vdemeester

Description

@vdemeester

Problem

The TestExamples/v1/pipelineruns/beta/pipelinerun-with-matrix e2e test has been consistently flaky in CI, causing build failures. The test file has been temporarily moved to the no-ci folder to prevent CI failures while we investigate and fix
the root cause.

The test was disabled in PR #9200 as a temporary measure.

Evidence of Flakiness

From issue #9062, the test has been failing with timeouts:

--- FAIL: TestExamples/v1/pipelineruns/beta/pipelinerun-with-matrix (605.80s)

Recent CI failures:

Tasks

  • Investigate why the pipelinerun-with-matrix example test is timing out (600+ seconds)
  • Identify the root cause of the flakiness
  • Implement a fix for the underlying issue
  • Move the test file back from examples/v1/pipelineruns/no-ci/pipelinerun-with-matrix.yaml to examples/v1/pipelineruns/beta/pipelinerun-with-matrix.yaml
  • Verify the test runs reliably in CI

Current Location

The test file is currently at: examples/v1/pipelineruns/no-ci/pipelinerun-with-matrix.yaml

It should be moved back to: examples/v1/pipelineruns/beta/pipelinerun-with-matrix.yaml once fixed.

Related Issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/testingIssues or PRs related to testinghelp wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.kind/flakeCategorizes issue or PR as related to a flakey test

    Type

    No type

    Projects

    Status

    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions