Position of Slot Attention

[Seunggu0305]

Is there a reason why slot attention is placed in the middle of the visual encoder?

Why is it not located at the end or every layer?

[Jazzcharles]

The position of slot attention is not the main focus of the paper, though, we have only compared
(1) adding the slot-attention after the 6-th layer.
(2) adding the slot-attention after the 6-th and 9-th layer.
and (1) performs reasonably well in visual grouping.

Perhaps you can try some variants.