Enable builds without direct torch.cuda availability and support sm89 / sm90. #5
+193
−58
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR allows for
monarch_cuda
kernel to be built for computessm80
,sm89
, andsm90
, which includes the following GPUs:Additionally the
setup.py
is updated to enable builds based onnvcc
availability but without directtorch.cuda
availability for flexible builds.Update:
The compiler flags have been abstracted to support both PTX and SASS builds while defaulting to the original Ampere-based PTX-only build i.e.
-gencode=arch=compute_80,code=compute_80
.Successfully tested by building a docker image and running tests under
tests/
: