Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐞 [Bug]: Node with 2x same GPUs: can either select 0 or 2 GPU, but not 1 of the 2 #3922

Open
1 task done
mik-tf opened this issue Feb 19, 2025 · 3 comments
Open
1 task done
Labels
dashboard type_bug Something isn't working
Milestone

Comments

@mik-tf
Copy link
Contributor

mik-tf commented Feb 19, 2025

Is there an existing issue for this?

  • I have searched the existing issues

which package/s did you face the problem with?

Dashboard

What happened?

The dashboard appears to have issues handling dual GPU configuration (2x same GPU model), preventing proper GPU selection

Steps To Reproduce

  • I reserve the dedicated node 7520 on mainnet with 2x Nvidia 4090 GPUs
  • I can't select one of the two GPUs
    • If I click on one GPU in the dropdown menu, both GPUs get selected

which network/s did you face the problem on?

Main

version

latest

Twin ID/s

No response

Node ID/s

7520

Farm ID/s

No response

Contract ID/s

No response

Relevant screenshots/screen records

Relevant log output

-
@mik-tf mik-tf added the type_bug Something isn't working label Feb 19, 2025
@AhmedHanafy725 AhmedHanafy725 added this to the 2.7.0 milestone Feb 20, 2025
@AhmedHanafy725 AhmedHanafy725 moved this to Accepted in 3.16.x Feb 20, 2025
@AhmedHanafy725
Copy link
Contributor

This node is reporting only one GPU card

Image

Can you please record this behavior so I can reproduce it?

@mik-tf
Copy link
Contributor Author

mik-tf commented Feb 20, 2025

@AhmedHanafy725 Yes I know. Good point. I asked the farmer to remove the second GPU card so we can test other things. See here: #3921 (comment)

I rented node 7367 with 2x same GPU, and it does not show in the Dashboard. It says no gpu.

Image


While this is not the same issue, it shows there's an issue showing GPUs even if the gridproxy and dashboard know there are 2 gpus, it can't be seen

My hypothesis for the original issue is that:

  • as we can see with gridproxy result, the GPU nodes are assigned the same ID, so they get both selected when user selects only 1 in the drop down menu.

@AhmedHanafy725
Copy link
Contributor

The GPU field is called the node itself to get the card IDs, but this node doesn't have any GPU cards https://gridproxy.grid.tf/nodes/7367/gpu, and for the count on the card, it comes from gridproxy and there is an issue for the GPU counts and should be resolved here threefoldtech/tfgrid-sdk-go#1325

@AhmedHanafy725 AhmedHanafy725 moved this from Accepted to Blocked in 3.16.x Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dashboard type_bug Something isn't working
Projects
Status: Blocked
Development

No branches or pull requests

2 participants