You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Aug 7, 2024. It is now read-only.
Summary:
To fix this error
```
RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.FloatTensor []] is at version 1; expected version 0 instead.
```
----
Also tried
```
torch.no_grad()
def sync_float8_amax_and_scale_history(
```
which didn't work.
----
We can look into if there are any better ways to fix this.
Pull Request resolved: #169
Test Plan: ./test/test_fsdp.sh
Reviewed By: vkuzo
Differential Revision: D52373985
Pulled By: y-sq
fbshipit-source-id: a25f4b0fee21dd5801c444b28f8a2f878bbafa35
0 commit comments