[DVC] Add RequestBasedMetaRepository to enable metadata retrieval directly from server #4303
Annotations
10 errors
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseAndBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
hostLevelIngestionStats.recordTotalBytesConsumed(
<any long>
);
Wanted 2 times:
-> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:499)
But was 1 time:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseAndBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
hostLevelIngestionStats.recordTotalBytesConsumed(
<any long>
);
Wanted 3 times:
-> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:499)
But was 2 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseWithoutBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.ArgumentsAreDifferent: Argument(s) are different! Wanted:
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=3, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=true, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testNotifier$35(StoreIngestionTaskTest.java:1619)
Actual invocations have different arguments:
storageMetadataService.getLastOffset(
"TestTopic_4a4754703a_c98a2b7d_v1",
1
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.getLastOffset(DeepCopyOffsetManager.java:49)
storageMetadataService.getLastOffset(
"TestTopic_4a4754703a_c98a2b7d_v1",
2
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.getLastOffset(DeepCopyOffsetManager.java:49)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@378ec030
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@53a59a19
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
2,
OffsetRecord{localVersionTopicOffset=1, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=1, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=2, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
2,
OffsetRecord{localVersionTopicOffset=2, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@62d0fefb
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@49de7692
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseWithoutBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
abstractStorageEngine.putWithReplicationMetadata(
1,
<any>,
<any>,
<any>
);
Wanted 200 times:
-> at com.linkedin.davinci.store.AbstractStorageEngine.putWithReplicationMetadata(AbstractStorageEngine.java:487)
But was 197 times:
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopySt
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/repository/NativeMetadataRepositoryTest.java#L140
java.lang.AssertionError: expected [2000.0] but found [1000.0]
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseAndBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
hostLevelIngestionStats.recordTotalBytesConsumed(
<any long>
);
Wanted 2 times:
-> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:499)
But was 1 time:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseAndBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
hostLevelIngestionStats.recordTotalBytesConsumed(
<any long>
);
Wanted 3 times:
-> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:499)
But was 2 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2629)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseWithoutBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.ArgumentsAreDifferent: Argument(s) are different! Wanted:
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=3, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=true, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testNotifier$35(StoreIngestionTaskTest.java:1619)
Actual invocations have different arguments:
storageMetadataService.getLastOffset(
"TestTopic_4a4754703a_c98a2b7d_v1",
1
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.getLastOffset(DeepCopyOffsetManager.java:49)
storageMetadataService.getLastOffset(
"TestTopic_4a4754703a_c98a2b7d_v1",
2
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.getLastOffset(DeepCopyOffsetManager.java:49)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@378ec030
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@53a59a19
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
2,
OffsetRecord{localVersionTopicOffset=1, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=1, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
1,
OffsetRecord{localVersionTopicOffset=2, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.put(
"TestTopic_4a4754703a_c98a2b7d_v1",
2,
OffsetRecord{localVersionTopicOffset=2, upstreamOffset=-1, leaderTopic=null, offsetLag=9223372036854775807, eventTimeEpochMs=1738880766388, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}, recordTransformerClassHash=null}
);
-> at com.linkedin.venice.offsets.DeepCopyOffsetManager.put(DeepCopyOffsetManager.java:38)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@62d0fefb
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
storageMetadataService.computeStoreVersionState(
"TestTopic_4a4754703a_c98a2b7d_v1",
com.linkedin.venice.offsets.DeepCopyStorageMetadataService$$Lambda$683/1915102300@49de7692
);
-> at com.linkedin.venice.offsets.DeepCopyStorageMetadataService.computeStoreVersionState(DeepCopyStorageMetadataService.java:34)
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithTWiseWithoutBufferAfterLeaderTest.java#L1
org.mockito.exceptions.verification.TooFewActualInvocations:
abstractStorageEngine.putWithReplicationMetadata(
1,
<any>,
<any>,
<any>
);
Wanted 200 times:
-> at com.linkedin.davinci.store.AbstractStorageEngine.putWithReplicationMetadata(AbstractStorageEngine.java:487)
But was 197 times:
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopyStorageEngine.java:160)
-> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.putWithReplicationMetadata(DeepCopySt
|
Publish Test Report:
clients/da-vinci-client/src/test/java/com/linkedin/davinci/repository/NativeMetadataRepositoryTest.java#L140
java.lang.AssertionError: expected [2000.0] but found [1000.0]
|
Loading