Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Modular Diffusers #9672

Open
wants to merge 68 commits into
base: main
Choose a base branch
from
+7,356 −62
Open

The Modular Diffusers #9672

Show file tree
Hide file tree
Changes from 53 commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
33f85fa
add
yiyixuxu Oct 14, 2024
52a7f1c
add dataflow info for each block in builder _repr_
yiyixuxu Oct 16, 2024
e8d0980
add img2img support - output does not match with non-modular pipeline…
yiyixuxu Oct 16, 2024
ad3f9a2
update img2img, result match
yiyixuxu Oct 17, 2024
ddea157
add from_pipe + run_blocks
yiyixuxu Oct 17, 2024
af9572d
controlnet
yiyixuxu Oct 19, 2024
2b6dcbf
fix controlnet
yiyixuxu Oct 20, 2024
70272b1
combine controlnetstep into contronetdesnoisestep
yiyixuxu Oct 20, 2024
46ec174
refactor guider, remove prepareguidance step to be combinedd into den…
yiyixuxu Oct 23, 2024
f1b3036
update pag guider - draft
yiyixuxu Oct 23, 2024
540d303
refactor guider
yiyixuxu Oct 26, 2024
6742f16
up
yiyixuxu Oct 27, 2024
005195c
add
yiyixuxu Oct 27, 2024
024a9f5
fix so that run_blocks can work with inputs in the state
yiyixuxu Oct 27, 2024
37e8dc7
remove img2img blocksgit status consolidate text2img and img2img
yiyixuxu Oct 27, 2024
8b811fe
refactor, from_pretrained, from_pipe, remove_blocks, replace_blocks
yiyixuxu Oct 30, 2024
c70a285
style
yiyixuxu Oct 30, 2024
ffc2992
add autostep (not complete)
yiyixuxu Nov 16, 2024
ace53e2
update/refactor
yiyixuxu Dec 10, 2024
a8df0f1
Modular APG (#10173)
hlky Dec 10, 2024
e50d614
only add model as expected_component when the model need to run for t…
yiyixuxu Dec 11, 2024
bc3d1c9
add model_cpu_offload_seq + _exlude_from_cpu_offload
yiyixuxu Dec 13, 2024
2b3cd2d
update
yiyixuxu Dec 14, 2024
b305c77
add offload support!
yiyixuxu Dec 14, 2024
0b90051
add vae encoder node
yiyixuxu Dec 19, 2024
806e8e6
Merge branch 'main' into modular-diffusers
yiyixuxu Dec 29, 2024
4fa85c7
add model_manager and global offloading method
yiyixuxu Dec 31, 2024
72d9a81
components manager
yiyixuxu Dec 31, 2024
10d4a77
style
yiyixuxu Dec 31, 2024
27dde51
add output arg to run_blocks
yiyixuxu Dec 31, 2024
8c02572
add memory_reserve_margin arg to auto offload
yiyixuxu Dec 31, 2024
a09ca7f
refactors: block __init__ no longer accept args. remove update_state…
yiyixuxu Jan 1, 2025
ed59f90
modular pipeline builder -> ModularPipeline
yiyixuxu Jan 1, 2025
72c5bf0
add a from_block class method to modular pipeline
yiyixuxu Jan 1, 2025
6c93626
remove run_blocks, just use __call__
yiyixuxu Jan 1, 2025
1d63306
make it work with lora
yiyixuxu Jan 3, 2025
2e0f5c8
start to add inpaint
yiyixuxu Jan 3, 2025
c12a05b
update to to not assume pipeline has hf_device_map
yiyixuxu Jan 3, 2025
54f410d
add inpaint
yiyixuxu Jan 6, 2025
6985906
controlnet input & remove the MultiPipelineBlocks class
yiyixuxu Jan 7, 2025
db94ca8
add controlnet inpaint + more refactor
yiyixuxu Jan 7, 2025
e973de6
fix contro;net inpaint preprocess
yiyixuxu Jan 8, 2025
7a34832
[modular] Stable Diffusion XL ControlNet Union (#10509)
hlky Jan 9, 2025
2220af6
refactor
yiyixuxu Jan 11, 2025
fb78f4f
Merge branch 'modular-diffusers' of github.com:huggingface/diffusers …
yiyixuxu Jan 11, 2025
0966663
adjust print
yiyixuxu Jan 11, 2025
7f897a9
fix
yiyixuxu Jan 12, 2025
a6804de
add controlnet union to auto & fix for pag
yiyixuxu Jan 12, 2025
7007f72
InputParam, OutputParam, get_auto_doc
yiyixuxu Jan 16, 2025
a226920
get_block_state make it less verbose
yiyixuxu Jan 17, 2025
77b5fa5
make it work with lora has both text_encoder & unet
yiyixuxu Jan 18, 2025
6e2fe26
fix more for lora
yiyixuxu Jan 18, 2025
68a5185
refactor more, ipadapter node, lora node
yiyixuxu Jan 20, 2025
d046cf7
block state + fix for num_images_per_prompt > 1 for denoise/controlne…
yiyixuxu Jan 22, 2025
71df158
Update src/diffusers/pipelines/stable_diffusion_xl/pipeline_stable_di…
yiyixuxu Jan 22, 2025
b3fb418
Merge branch 'modular-diffusers' of github.com:huggingface/diffusers …
yiyixuxu Jan 22, 2025
00cae4e
docstring doc doc doc
yiyixuxu Jan 23, 2025
ccb35ac
Merge branch 'main' into modular-diffusers
yiyixuxu Jan 23, 2025
00a3bc9
fix
yiyixuxu Jan 23, 2025
4bed3e3
up up
yiyixuxu Jan 26, 2025
c7020df
add model_info
yiyixuxu Jan 27, 2025
2c3e4ea
fix
yiyixuxu Jan 29, 2025
e5089d7
update
yiyixuxu Jan 31, 2025
8ddb20b
up
yiyixuxu Feb 1, 2025
cff0fd6
more refactor
yiyixuxu Feb 1, 2025
485f8d1
more refactor
yiyixuxu Feb 1, 2025
addaad0
more more more refactor
yiyixuxu Feb 3, 2025
12650e1
up
yiyixuxu Feb 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions src/diffusers/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -162,6 +162,7 @@
"KarrasVePipeline",
"LDMPipeline",
"LDMSuperResolutionPipeline",
"ModularPipeline",
"PNDMPipeline",
"RePaintPipeline",
"ScoreSdeVePipeline",
Expand Down Expand Up @@ -398,6 +399,7 @@
"StableDiffusionXLImg2ImgPipeline",
"StableDiffusionXLInpaintPipeline",
"StableDiffusionXLInstructPix2PixPipeline",
"StableDiffusionXLModularPipeline",
"StableDiffusionXLPAGImg2ImgPipeline",
"StableDiffusionXLPAGInpaintPipeline",
"StableDiffusionXLPAGPipeline",
Expand Down Expand Up @@ -672,6 +674,7 @@
KarrasVePipeline,
LDMPipeline,
LDMSuperResolutionPipeline,
ModularPipeline,
PNDMPipeline,
RePaintPipeline,
ScoreSdeVePipeline,
Expand Down Expand Up @@ -885,6 +888,7 @@
StableDiffusionXLImg2ImgPipeline,
StableDiffusionXLInpaintPipeline,
StableDiffusionXLInstructPix2PixPipeline,
StableDiffusionXLModularPipeline,
StableDiffusionXLPAGImg2ImgPipeline,
StableDiffusionXLPAGInpaintPipeline,
StableDiffusionXLPAGPipeline,
Expand Down
Loading
Loading