🚀 Nunchaku v0.1.4 Released!
This update brings significant improvements and bug fixes:
- Enhanced Low-Memory Inference: Added support for 4-bit text encoder and per-layer CPU offloading, reducing FLUX’s minimum memory requirement to just 4 GiB while maintaining a 2–3× speedup. (#131, #144, #119)
- Improved Generation Stability: Fixed issues affecting any-resolution generation. (#129, #43)
- LoRA Compatibility Fixes: Resolved various LoRA-related issues. (#135, #108)
- Memory Management Improvements: Addressed pin memory issues for better stability. (#49, #141, #154)
- ComfyUI Integration Fixes: Resolved directory-related issues. (#145)
Latest Linux wheels are available at https://huggingface.co/mit-han-lab/nunchaku/tree/main.