Skip to content

Issues: linkedin/Liger-Kernel

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

49 Open 116 Closed
49 Open 116 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Incorrect import path
#565 opened Feb 14, 2025 by Jokeren
Support IBM Granite 3.(0, 1) models
#557 opened Feb 4, 2025 by JamesKunstle
1
[RFC] Liger FlexChunkLoss: Grouping Loss
#548 opened Jan 29, 2025 by austin362667
1 task
1
The convergence test test_mini_models_with_logits is failing with the latest transformers bug Something isn't working
#543 opened Jan 27, 2025 by Tcc0403
1
7
revert_liger_kernel_to_xxx can't revert LigerCrossEntropyLoss for transformers>=4.46.1 bug Something isn't working
#542 opened Jan 27, 2025 by Tcc0403
7
Issue while building from source on ROCM
#538 opened Jan 22, 2025 by agunapal
3
Support the new Solar architecture
#537 opened Jan 22, 2025 by arnavgarg1
Gradient checkpointing for grad_weight in LFCE
#533 opened Jan 20, 2025 by cassanof
4
For better numerical accuracy in LayerNorm
#518 opened Jan 9, 2025 by nhamanasu
2
Memory Optimization with Liger Kernel Shows Limited Effect on larger Model （more than 7B）
#517 opened Jan 8, 2025 by dyyoungg
3
Any plans to add models from the llava series?
#514 opened Jan 6, 2025 by jp1924
@jp1924
12
Megatron Support
#513 opened Jan 4, 2025 by huyiwen
LigerFusedLinearCrossEntropyLoss Causes Training Loss to Diverge After Reaching ~8
#512 opened Jan 4, 2025 by penghui-yang
7
Consider support liger kernel for internlm model
#505 opened Dec 29, 2024 by 14H034160212
Extending Liger-Kernel Optimizations to Encoder Models Like BER
#500 opened Dec 26, 2024 by pengzhangzhi
error when run sh run_qwen.sh good first issue Good for newcomers
#487 opened Dec 18, 2024 by CharlesJhonson
1
3
Potential Optimization for Preference Training with Prefix Sharing
#476 opened Dec 13, 2024 by austin362667
@austin362667
Support offline logits for teacher model
#441 opened Dec 9, 2024 by austin362667
@austin362667
Bug in chunking?
#439 opened Dec 8, 2024 by cinjon
10
PreferenceBase with Softcapping?
#426 opened Dec 4, 2024 by cinjon
1
2
The accuracy is misaligned when using bf16
#414 opened Nov 28, 2024 by starstream
No Significant Improvement Observed in Model Training Speed
#409 opened Nov 27, 2024 by lianghsun
8
Weighted Cross Entropy Loss
#404 opened Nov 21, 2024 by winglian
2
4
ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)
#401 opened Nov 20, 2024 by shivam15s
1
Apple's cross entropy computation
#391 opened Nov 17, 2024 by fzyzcjy
8
ProTip! Type g i on any issue or pull request to go back to the issue listing page.