-
Notifications
You must be signed in to change notification settings - Fork 29
Xarray GPU optimization #771
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
@negin513 is attempting to deploy a commit to the xarray Team on Vercel. A member of the Team first needs to authorize it. |
for more information, see https://pre-commit.ci
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for writing this up!
Co-authored-by: Tom Augspurger <[email protected]>
- name: Katelyn Fitzgerald | ||
github: kafitzgerald | ||
|
||
summary: 'How to accelerate AI/ML workflows in Earth Sciences with GPU-native Xarray and Zarr.' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we make this more direct? "X% speedup" or "XMBps throughput"?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added ~17X all in all improvement!💪💪💪
for more information, see https://pre-commit.ci
Co-authored-by: Max Jones <[email protected]>
for more information, see https://pre-commit.ci
Hey folks, I think I have addressed all comments & added all the plots, if either one of you can review this: all in all +DALI +nvcomp ~17x improvement... 💪 |
merging in time for a scipy talk! |
Contributors: @negin513, @weiji14 , @TomAugspurger , @maxrjoes, @akshaysubr, @kafitzgerald