Moved old_per_token_logps acquisition from torch.inference_mode to torch.no_grad
#1
| Job | Run time |
|---|---|
| 0s | |
| 0s |
old_per_token_logps acquisition from torch.inference_mode to torch.no_grad
#1
| Job | Run time |
|---|---|
| 0s | |
| 0s |