Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run with distilled model #1

Closed
kmpartner opened this issue Jun 5, 2024 · 6 comments
Closed

run with distilled model #1

kmpartner opened this issue Jun 5, 2024 · 6 comments

Comments

@kmpartner
Copy link

Is it possible to run distilled model (Block-removed Knowledge-distilled Stable Diffusion, https://github.com/Nota-NetsPresso/BK-SDM).

When I tried to some distilled model. I got error message similar to "unknown mid_block_type" , probably because of unet structure changed.

@lavinal712
Copy link
Owner

You should train your own model to fit the distilled model.

@kmpartner
Copy link
Author

kmpartner commented Jun 9, 2024

Thank you for response.

@kmpartner
Copy link
Author

kmpartner commented Jun 10, 2024

What model and dataset are used for test images generation?

@lavinal712
Copy link
Owner

What model and dataset are used for test images generation?

SD1.5
test image is in lllyasviel/ControlNet#188

@kmpartner
Copy link
Author

I tried to train ControlLoRA by using code in page, then tried to resume from created checkpoint. But resume from the checkpoint does not work in ControlLoRA training.
Error message say, config.json not found.

How can I solve this problem?

@lavinal712
Copy link
Owner

lavinal712 commented Jun 13, 2024

I tried to train ControlLoRA by using code in page, then tried to resume from created checkpoint. But resume from the checkpoint does not work in ControlLoRA training. Error message say, config.json not found.

How can I solve this problem?

Well, the code doesn't support from resume from created checkpoint for now as it only stores lora layers. Please retrain a new model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants