MirrorMaker 2.0 Consumer Group Offset Syncing Lag in Active-Passive DR Setup

[prth]

We are using Strimzi’s Kafka MirrorMaker 2.0 to replicate messages and consumer group offsets between two regions in an active-passive (DR) setup. While messages sync correctly, we observe significant lag in consumer group offset syncing.

Issue Description
• Message replication is working fine, with no noticeable lag.
• Consumer group offsets are not syncing in a timely manner.

Here is configuration used for source and checkpoint connector

     sourceConnector:
        tasksMax: 4
        config:
          replication.factor: -1
          offset-syncs.topic.replication.factor: -1
          refresh.topics.interval.seconds: 600
          replication.policy.class: "org.apache.kafka.connect.mirror.IdentityReplicationPolicy" 
          consumer.auto.offset.reset: earliest 
          offset.lag.max: 5
          sync.topic.acls.enabled: false
      checkpointConnector:
        tasksMax: 4
        config:
          checkpoints.topic.replication.factor: -1
          sync.group.offsets.enabled: true
          refresh.groups.interval.seconds: 10
          replication.policy.class: "org.apache.kafka.connect.mirror.IdentityReplicationPolicy"
          emit.checkpoints.interval.seconds: 5
          sync.group.offsets.interval.seconds: 5
      topicsPattern: "^(?!mirrormaker2-).*"
      groupsPattern: ".*"

We tried tuning/reducing consumer group sync intervals (emit.checkpoints.interval.seconds, sync.group.offsets.interval.seconds), but the issue persists.
We also reduced offset.lag.max on the source connector, but it did not improve offset syncing.

Are there any configurations we can tweak to improve consumer offset syncing performance?

[scholzj]

I guess a good start would be:

• Proper explanation what significant lag means
• Full custom resource
• Full logs