Code

The Modular Diffusers#9672

Code

Open

yiyixuxu wants to merge 68 commits intomainhuggingface/diffusers:mainfrom modular-diffusershuggingface/diffusers:modular-diffusersCopy head branch name to clipboard

+7,356-62

Commits

Commits on Oct 14, 2024

• add

  yiyixuxu

  committed
  33f85fa

  Copy full SHA for 33f85fa

Commits on Oct 16, 2024

• add dataflow info for each block in builder _repr_

  yiyixuxu

  committed
  52a7f1c

  Copy full SHA for 52a7f1c

• add img2img support - output does not match with non-modular pipeline completely yet (look into later)

  yiyixuxu

  committed
  e8d0980

  Copy full SHA for e8d0980

Commits on Oct 17, 2024

• update img2img, result match

  yiyixuxu

  committed
  ad3f9a2

  Copy full SHA for ad3f9a2

• add from_pipe + run_blocks

  yiyixuxu

  committed
  ddea157

  Copy full SHA for ddea157

Commits on Oct 19, 2024

• controlnet

  yiyixuxu

  committed
  af9572d

  Copy full SHA for af9572d

Commits on Oct 20, 2024

• fix controlnet

  yiyixuxu

  committed
  2b6dcbf

  Copy full SHA for 2b6dcbf

• combine controlnetstep into contronetdesnoisestep

  yiyixuxu

  committed
  70272b1

  Copy full SHA for 70272b1

Commits on Oct 23, 2024

• refactor guider, remove prepareguidance step to be combinedd into denoisestep

  yiyixuxu

  committed
  46ec174

  Copy full SHA for 46ec174

• update pag guider - draft

  yiyixuxu

  committed
  f1b3036

  Copy full SHA for f1b3036

Commits on Oct 26, 2024

• refactor guider

  yiyixuxu

  committed
  540d303

  Copy full SHA for 540d303

Commits on Oct 27, 2024

• up

  yiyixuxu

  committed
  6742f16

  Copy full SHA for 6742f16

• add

  yiyixuxu

  committed
  005195c

  Copy full SHA for 005195c

• fix so that run_blocks can work with inputs in the state

  yiyixuxu

  committed
  024a9f5

  Copy full SHA for 024a9f5

• remove img2img blocksgit status consolidate text2img and img2img

  yiyixuxu

  committed
  37e8dc7

  Copy full SHA for 37e8dc7

Commits on Oct 30, 2024

• refactor, from_pretrained, from_pipe, remove_blocks, replace_blocks

  yiyixuxu

  committed
  8b811fe

  Copy full SHA for 8b811fe

• style

  yiyixuxu

  committed
  c70a285

  Copy full SHA for c70a285

Commits on Nov 16, 2024

• add autostep (not complete)

  yiyixuxu

  committed
  ffc2992

  Copy full SHA for ffc2992

Commits on Dec 10, 2024

• update/refactor

  yiyixuxu

  committed
  ace53e2

  Copy full SHA for ace53e2

• Modular APG (#10173)

  hlky

  authored
  a8df0f1

  Copy full SHA for a8df0f1

Commits on Dec 11, 2024

• only add model as expected_component when the model need to run for the block, currently it's added even when only config is needed

  yiyixuxu

  committed
  e50d614

  Copy full SHA for e50d614

Commits on Dec 13, 2024

• add model_cpu_offload_seq + _exlude_from_cpu_offload

  yiyixuxu

  committed
  bc3d1c9

  Copy full SHA for bc3d1c9

Commits on Dec 14, 2024

• update

  yiyixuxu

  committed
  2b3cd2d

  Copy full SHA for 2b3cd2d

• add offload support!

  yiyixuxu

  committed
  b305c77

  Copy full SHA for b305c77

Commits on Dec 19, 2024

• add vae encoder node

  yiyixuxu

  committed
  0b90051

  Copy full SHA for 0b90051

Commits on Dec 29, 2024

• Merge branch 'main' into modular-diffusers

  yiyixuxu

  authored
  806e8e6

  Copy full SHA for 806e8e6

Commits on Dec 31, 2024

• add model_manager and global offloading method

  yiyixuxu

  committed
  4fa85c7

  Copy full SHA for 4fa85c7

• components manager

  yiyixuxu

  committed
  72d9a81

  Copy full SHA for 72d9a81

• style

  yiyixuxu

  committed
  10d4a77

  Copy full SHA for 10d4a77

• add output arg to run_blocks

  yiyixuxu

  committed
  27dde51

  Copy full SHA for 27dde51

• add memory_reserve_margin arg to auto offload

  yiyixuxu

  committed
  8c02572

  Copy full SHA for 8c02572

Commits on Jan 1, 2025

• refactors: block __init__ no longer accept args. remove update_states from pipeline blocks, add update_states to modularpipeline, remove multi-block support for modular pipeline, remove offload su…

  Show description for a09ca7f
  yiyixuxu

  committed
  a09ca7f

  Copy full SHA for a09ca7f

• modular pipeline builder -> ModularPipeline

  yiyixuxu

  committed
  ed59f90

  Copy full SHA for ed59f90

• add a from_block class method to modular pipeline

  yiyixuxu

  committed
  72c5bf0

  Copy full SHA for 72c5bf0

• remove run_blocks, just use __call__

  yiyixuxu

  committed
  6c93626

  Copy full SHA for 6c93626

Commits on Jan 3, 2025

• make it work with lora

  yiyixuxu

  committed
  1d63306

  Copy full SHA for 1d63306

• start to add inpaint

  yiyixuxu

  committed
  2e0f5c8

  Copy full SHA for 2e0f5c8

• update to to not assume pipeline has hf_device_map

  yiyixuxu

  committed
  c12a05b

  Copy full SHA for c12a05b

Commits on Jan 6, 2025

• add inpaint

  yiyixuxu

  committed
  54f410d

  Copy full SHA for 54f410d

Commits on Jan 7, 2025

• controlnet input & remove the MultiPipelineBlocks class

  yiyixuxu

  committed
  6985906

  Copy full SHA for 6985906

• add controlnet inpaint + more refactor

  yiyixuxu

  committed
  db94ca8

  Copy full SHA for db94ca8

Commits on Jan 8, 2025

• fix contro;net inpaint preprocess

  yiyixuxu

  committed
  e973de6

  Copy full SHA for e973de6

Commits on Jan 9, 2025

• [modular] Stable Diffusion XL ControlNet Union (#10509)

  Show description for 7a34832
  hlky

  authored
  7a34832

  Copy full SHA for 7a34832

Commits on Jan 11, 2025

• refactor

  yiyixuxu

  committed
  2220af6

  Copy full SHA for 2220af6

• Merge branch 'modular-diffusers' of github.com:huggingface/diffusers into modular-diffusers

  yiyixuxu

  committed
  fb78f4f

  Copy full SHA for fb78f4f

• adjust print

  yiyixuxu

  committed
  0966663

  Copy full SHA for 0966663

Commits on Jan 12, 2025

• fix

  yiyixuxu

  committed
  7f897a9

  Copy full SHA for 7f897a9

• add controlnet union to auto & fix for pag

  yiyixuxu

  committed
  a6804de

  Copy full SHA for a6804de

Commits on Jan 16, 2025

• InputParam, OutputParam, get_auto_doc

  yiyixuxu

  committed
  7007f72

  Copy full SHA for 7007f72

Commits on Jan 17, 2025

• get_block_state make it less verbose

  yiyixuxu

  committed
  a226920

  Copy full SHA for a226920

Commits on Jan 18, 2025

• make it work with lora has both text_encoder & unet

  yiyixuxu

  committed
  77b5fa5

  Copy full SHA for 77b5fa5

• fix more for lora

  yiyixuxu

  committed
  6e2fe26

  Copy full SHA for 6e2fe26

Commits on Jan 20, 2025

• refactor more, ipadapter node, lora node

  yiyixuxu

  committed
  68a5185

  Copy full SHA for 68a5185

Commits on Jan 22, 2025

• block state + fix for num_images_per_prompt > 1 for denoise/controlnet union etc

  yiyixuxu

  committed
  d046cf7

  Copy full SHA for d046cf7

• Update src/diffusers/pipelines/stable_diffusion_xl/pipeline_stable_diffusion_xl_modular.py

  Show description for 71df158
  

  yiyixuxu

  and

  asomoza

  authored
  71df158

  Copy full SHA for 71df158

• Merge branch 'modular-diffusers' of github.com:huggingface/diffusers into modular-diffusers

  yiyixuxu

  committed
  b3fb418

  Copy full SHA for b3fb418

Commits on Jan 23, 2025

• docstring doc doc doc

  yiyixuxu

  committed
  00cae4e

  Copy full SHA for 00cae4e

• Merge branch 'main' into modular-diffusers

  yiyixuxu

  authored
  ccb35ac

  Copy full SHA for ccb35ac

• fix

  yiyixuxu

  committed
  00a3bc9

  Copy full SHA for 00a3bc9

Commits on Jan 26, 2025

• up up

  yiyixuxu

  committed
  4bed3e3

  Copy full SHA for 4bed3e3

Commits on Jan 27, 2025

• add model_info

  yiyixuxu

  committed
  c7020df

  Copy full SHA for c7020df

Commits on Jan 29, 2025

• fix

  yiyixuxu

  committed
  2c3e4ea

  Copy full SHA for 2c3e4ea

Commits on Jan 31, 2025

• update

  yiyixuxu

  committed
  e5089d7

  Copy full SHA for e5089d7

Commits on Feb 1, 2025

• up

  yiyixuxu

  committed
  8ddb20b

  Copy full SHA for 8ddb20b

• more refactor

  yiyixuxu

  committed
  cff0fd6

  Copy full SHA for cff0fd6

• more refactor

  yiyixuxu

  committed
  485f8d1

  Copy full SHA for 485f8d1

Commits on Feb 3, 2025

• more more more refactor

  yiyixuxu

  committed
  addaad0

  Copy full SHA for addaad0

Commits on Feb 4, 2025

• up

  yiyixuxu

  committed
  12650e1

  Copy full SHA for 12650e1