Training a new task

[nlylmz]

Hi, thank you for your work. It is an excellent job! I would like to learn how to train a new task with different images on the Prompt Diffusion.
My task has the same structure as yours; Image 1, Image 2 and Image 3. However, the task and images are different and I am not sure if I need to do something extra to train the images on the task. Because you are using annotators from ControlNet but, for my task, it is not available. Could you please provide some steps what I should do for training my task with different images?

[Zhendong-Wang]

If you already have (image1, image2) forming the example pair, and image3 as the query image, then you can directly start the training with our pipeline. You need to modify the dataset file https://github.com/Zhendong-Wang/Prompt-Diffusion/blob/main/edit_dataset.py to be consisent with your dataset.

[nlylmz]

Thanks a lot for your reply.