Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Apply gradient accumulation fix to DPO/PPO recipes #2334

Open
bogdansalyp opened this issue Feb 3, 2025 · 2 comments
Open

Apply gradient accumulation fix to DPO/PPO recipes #2334

bogdansalyp opened this issue Feb 3, 2025 · 2 comments
Assignees
@ebsmothers

Comments

@bogdansalyp
Copy link
Contributor

bogdansalyp commented Feb 3, 2025 •
edited
Loading

https://unsloth.ai/blog/gradient

Image
@SalmanMohammadi SalmanMohammadi marked this as a duplicate of #2037 Feb 3, 2025
@bogdansalyp
Copy link
Contributor Author

Depends on #2335

@bogdansalyp
Copy link
Contributor Author

SFT fix was addressed here: #1875

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ebsmothers ebsmothers

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bogdansalyp @ebsmothers