Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding rds-core to e2e-ci #62177

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

vishnuchalla
Copy link
Contributor

@vishnuchalla vishnuchalla commented Feb 27, 2025

Description

Adding rds-core to e2e-ci
JIRA: https://issues.redhat.com/browse/PERFSCALE-3705

Testing

Need to verify it through this PR rehearsal

Signed-off-by: Vishnu Challa <[email protected]>
@openshift-ci openshift-ci bot requested review from chentex and krishvoor February 27, 2025 14:52
Copy link
Contributor

openshift-ci bot commented Feb 27, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vishnuchalla

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 27, 2025
@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vishnuchalla
Copy link
Contributor Author

/assign @josecastillolema

@vishnuchalla
Copy link
Contributor Author

/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 27, 2025
@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: job(s): pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node either don't exist or were not found to be affected, and cannot be rehearsed

pushd /tmp


git clone https://github.com/vishnuchalla/e2e-benchmarking --branch v0.0.1 --depth 1
Copy link
Contributor Author

@vishnuchalla vishnuchalla Feb 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is to quickly test this functionality. Once done we will add checks to only run on e2e PRs.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we have this step moved to ci-operator/step-registry/openshift-qe/rds-core instead please?
Also, you may want to assign yourself to PERFSCALE-3646 - Create a RDS Prow step

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for sharing the JIRA. I have hyperlinked in the one I have in this PR description.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we have this step moved to ci-operator/step-registry/openshift-qe/rds-core instead please?

Unfortunately no. This test has a different purpose to only run against e2e CI. And we want these e2e CI tests to be decoupled from the actual production CI runs to avoid unnecessary noise.

For example if we look at cd-v2, we have two versions of it.
One is the actual production run: https://github.com/openshift/release/tree/master/ci-operator/step-registry/openshift-qe/cluster-density-v2
Another that runs againt e2e CI with minimal configuration: https://github.com/openshift/release/tree/master/ci-operator/step-registry/cloud-bulldozer/e2e-benchmarking/cluster-density-v2
Both are different and have a different purpose.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ahh ok I wasnt aware that there where two of them, noted.

@vishnuchalla
Copy link
Contributor Author

/unhold

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 27, 2025
@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: job(s): pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node either don't exist or were not found to be affected, and cannot be rehearsed

- intranet
restrict_network_access: false
steps:
cluster_profile: metal-perscale-cpt
Copy link
Contributor

@josecastillolema josecastillolema Feb 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I dont think this is the right place to test this. A better candidate would be the jetlag ci cluster:

cluster_profile: metal-perfscale-jetlag

Also to move to the jetlag CI cluster you need to add some envs:

      BASTION_CP_INTERFACE: ens7f1
      LAB_CLOUD: cloud19
      LAB_INTERFACE: eno3
      NUM_WORKER_NODES: "2"

cc @jtaleric @akrzos @radez

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, may need to overwrite some vars to adjust the SRIOV and the perf-profile setup to the jetlag CI cluster

Copy link
Contributor Author

@vishnuchalla vishnuchalla Feb 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@josecastillolema may I know why are you suggesting jetlag CI over this one? If this is aiming movement of all our current jobs, can we take it in a different PR?

Copy link
Contributor

@josecastillolema josecastillolema Feb 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not all the current jobs, but the e2e-bencharking CI will be better placed on the jetlag CI environment for several reasons:

  • The BM CPT env is almost fully occupied all the day, we have 2 daily tests (each of them taking about 6/7h) + some weekly tests.
  • @jtaleric and I have been discussing how we would like to leave the BM CPT cluster for "production" data and leverage the jetlag CI cluster for the functional testing moving forward.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Understood and acknowledged.

@vishnuchalla
Copy link
Contributor Author

/pj-rehearse network-access-allowed

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: PR author isn't allowed to allow network access rehearsals. This must be done by a different member of the openshift org

@mohit-sheth
Copy link
Member

/pj-rehearse network-access-allowed

@openshift-ci-robot
Copy link
Contributor

@mohit-sheth: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

oc config view
oc projects
pushd /tmp

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are missing some pre-reqs: https://github.com/kube-burner/kube-burner-ocp/tree/main?tab=readme-ov-file#core-rds-workloads

We need one host labeled as worker-dpdk and another one as worker-metallb. In openshift-qe/installer/bm/day2/label there is a step that you can reuse to label the nodes.

@mohit-sheth
Copy link
Member

/pj-rehearse network-access-allowed

@openshift-ci-robot
Copy link
Contributor

@mohit-sheth: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: job(s): pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node either don't exist or were not found to be affected, and cannot be rehearsed

@jubittajohn
Copy link

/pj-rehearse network-access-allowed

@openshift-ci-robot
Copy link
Contributor

@jubittajohn: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@vishnuchalla
Copy link
Contributor Author

/pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

@openshift-ci-robot
Copy link
Contributor

@vishnuchalla: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

Signed-off-by: Vishnu Challa <[email protected]>
Signed-off-by: Vishnu Challa <[email protected]>
@openshift-ci-robot
Copy link
Contributor

[REHEARSALNOTIFIER]
@vishnuchalla: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-udn-density-pods-l2-single-node cloud-bulldozer/e2e-benchmarking presubmit Presubmit changed
pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-udn-density-pods-l3-single-node cloud-bulldozer/e2e-benchmarking presubmit Presubmit changed

The following jobs are not rehearsable without the network-access-rehearsals-ok, and approved labels present on this PR. This is due to the restrict_network_access field being set to false. The network-access-rehearsals-ok label can be added by any openshift org member other than the PR's author by commenting: /pj-rehearse network-access-allowed:

Test name
pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

Copy link
Contributor

openshift-ci bot commented Feb 28, 2025

@vishnuchalla: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/cloud-bulldozer/e2e-benchmarking/master/e2e-rds-core-single-node 73bbe60 link unknown /pj-rehearse pull-ci-cloud-bulldozer-e2e-benchmarking-master-e2e-rds-core-single-node

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants