Skip to content

[Question] about EPv2 hybrid mode get_theoretical_num_qps #631

@huakainomore

Description

@huakainomore

hybrid mode set num_qps to num_sms * 16 + 1, But it seems only kNumChannelsPerSM were used and kNumMaxChannelsPerSM is 8, So is num_sms * 8 enough?

    const auto [qp_idx, sharing_mode] = comm::get_qp_mode<kNumSMs, kNumQPs, kNumChannelsPerSM, (kNumNotifyWarps > 0)>(
        sm_idx, (warp_idx - kNumNotifyWarps) % kNumChannelsPerSM, warp_idx < kNumNotifyWarps);
    const auto gin = handle::NCCLGin(nccl_dev_comm, nccl_window, qp_idx, sharing_mode);

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions