Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Calibration dataset collect #46

Open
Manojbhat09 opened this issue Feb 8, 2025 · 0 comments
Open

Calibration dataset collect #46

Manojbhat09 opened this issue Feb 8, 2025 · 0 comments

Comments

@Manojbhat09
Copy link

This is the log for the command after installing deepcompressor;

python -m deepcompressor.app.diffusion.dataset.collect.calib     configs/model/flux.1-schnell.yaml configs/collect/qdiff.yaml

(nunchaku) [email protected]:/home/mbhat/deepcompressor/examples/diffusion$ python -m deepcompressor.app.diffusion.dataset.collect.calib     configs/model/flux.1-schnell.yaml configs/collect/qdiff.yaml
Warning: unused configurations {'eval': {'num_frames': None, 'fps': None}}
Saving caches to datasets/torch.bfloat16/flux.1-schnell/fmeuler4-g0/qdiff/s128
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00,  6.09it/s]
Loading pipeline components...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [00:01<00:00,  4.70it/s]
2025-02-08:05:50:13,066 INFO     [patch.py:60] Replacing fused Linear with ConcatLinear.
2025-02-08:05:50:13,067 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.0 with ConcatLinear.
2025-02-08:05:50:13,067 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:13,067 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:13,368 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.1 with ConcatLinear.
2025-02-08:05:50:13,368 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:13,368 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:13,784 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.2 with ConcatLinear.
2025-02-08:05:50:13,784 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:13,784 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:14,195 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.3 with ConcatLinear.
2025-02-08:05:50:14,195 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:14,195 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:14,593 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.4 with ConcatLinear.
2025-02-08:05:50:14,593 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:14,593 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:14,999 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.5 with ConcatLinear.
2025-02-08:05:50:14,999 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:14,999 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:15,393 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.6 with ConcatLinear.
2025-02-08:05:50:15,393 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:15,393 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:15,799 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.7 with ConcatLinear.
2025-02-08:05:50:15,799 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:15,799 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:16,198 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.8 with ConcatLinear.
2025-02-08:05:50:16,198 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:16,198 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:16,593 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.9 with ConcatLinear.
2025-02-08:05:50:16,593 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:16,593 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:16,999 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.10 with ConcatLinear.
2025-02-08:05:50:16,999 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:16,999 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:17,397 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.11 with ConcatLinear.
2025-02-08:05:50:17,397 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:17,397 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:17,793 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.12 with ConcatLinear.
2025-02-08:05:50:17,793 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:17,793 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:18,196 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.13 with ConcatLinear.
2025-02-08:05:50:18,196 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:18,196 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:18,598 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.14 with ConcatLinear.
2025-02-08:05:50:18,598 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:18,598 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:18,993 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.15 with ConcatLinear.
2025-02-08:05:50:18,993 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:18,993 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:19,392 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.16 with ConcatLinear.
2025-02-08:05:50:19,392 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:19,392 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:19,798 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.17 with ConcatLinear.
2025-02-08:05:50:19,798 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:19,798 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:20,201 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.18 with ConcatLinear.
2025-02-08:05:50:20,201 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:20,201 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:20,599 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.19 with ConcatLinear.
2025-02-08:05:50:20,599 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:20,599 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:20,997 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.20 with ConcatLinear.
2025-02-08:05:50:20,997 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:20,997 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:21,400 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.21 with ConcatLinear.
2025-02-08:05:50:21,400 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:21,400 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:21,799 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.22 with ConcatLinear.
2025-02-08:05:50:21,799 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:21,799 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:22,194 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.23 with ConcatLinear.
2025-02-08:05:50:22,194 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:22,194 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:22,593 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.24 with ConcatLinear.
2025-02-08:05:50:22,593 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:22,593 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:22,999 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.25 with ConcatLinear.
2025-02-08:05:50:22,999 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:22,999 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:23,398 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.26 with ConcatLinear.
2025-02-08:05:50:23,398 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:23,398 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:23,802 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.27 with ConcatLinear.
2025-02-08:05:50:23,802 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:23,802 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:24,201 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.28 with ConcatLinear.
2025-02-08:05:50:24,201 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:24,201 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:24,597 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.29 with ConcatLinear.
2025-02-08:05:50:24,598 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:24,598 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:25,000 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.30 with ConcatLinear.
2025-02-08:05:50:25,000 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:25,000 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:25,399 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.31 with ConcatLinear.
2025-02-08:05:50:25,399 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:25,399 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:25,794 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.32 with ConcatLinear.
2025-02-08:05:50:25,794 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:25,794 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:26,193 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.33 with ConcatLinear.
2025-02-08:05:50:26,193 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:26,193 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:26,592 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.34 with ConcatLinear.
2025-02-08:05:50:26,592 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:26,592 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:26,998 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.35 with ConcatLinear.
2025-02-08:05:50:26,998 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:26,998 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:27,395 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.36 with ConcatLinear.
2025-02-08:05:50:27,395 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:27,395 INFO     [patch.py:67] - out_features = 3072
2025-02-08:05:50:27,794 INFO     [patch.py:64] + Replacing fused Linear in single_transformer_blocks.37 with ConcatLinear.
2025-02-08:05:50:27,794 INFO     [patch.py:66] - in_features = 3072/15360
2025-02-08:05:50:27,794 INFO     [patch.py:67] - out_features = 3072
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/dataset/collect/calib.py", line 121, in <module>
    collect(ptq_config, filenames=filenames, dataset=dataset)
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/dataset/collect/calib.py", line 32, in collect
    pipeline = config.pipeline.build()
               ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/pipeline/config.py", line 105, in build
    return self._pipeline_factories[self.name](
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/pipeline/config.py", line 322, in _default_build
    replace_up_block_conv_with_concat_conv(model)
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/patch.py", line 22, in replace_up_block_conv_with_concat_conv
    model_struct = DiffusionModelStruct.construct(model)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/base.py", line 146, in construct
    return factory(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 237, in _default_construct
    return DiTStruct.construct(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/base.py", line 146, in construct
    return factory(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 1703, in _default_construct
    return FluxStruct.construct(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/base.py", line 146, in construct
    return factory(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 1840, in _default_construct
    return FluxStruct(
           ^^^^^^^^^^^
  File "<string>", line 23, in __init__
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 1794, in __post_init__
    self.single_transformer_block_structs = [
                                            ^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 1795, in <listcomp>
    self.single_transformer_block_struct_cls.construct(
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/base.py", line 146, in construct
    return factory(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 660, in _default_construct
    return DiffusionTransformerBlockStruct(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<string>", line 26, in __init__
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 535, in __post_init__
    super().__post_init__()
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/attn.py", line 647, in __post_init__
    self.attn_structs = [
                        ^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/attn.py", line 648, in <listcomp>
    self.attn_struct_cls.construct(
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/nn/struct/base.py", line 146, in construct
    return factory(module, parent=parent, fname=fname, rname=rname, rkey=rkey, idx=idx, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/mbhat/miniconda/envs/nunchaku/lib/python3.11/site-packages/deepcompressor/app/diffusion/nn/struct.py", line 332, in _default_construct
    o_proj = module.to_out[0]
             ~~~~~~~~~~~~~^^^
TypeError: 'NoneType' object is not subscriptable

I believe its after loading the pipeline through the factory,
is some part of code missing?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Manojbhat09