[da-vinci][cdc][server][test] DVRT CDC improvements and RocksDB optimizations #10120
kvarghaVeniceCI-StaticAnalysisAndUnitTests.yml
on: pull_request
Matrix: Clients / UT & CodeCov
Matrix: Controller / UT & CodeCov
Matrix: Integrations / UT & CodeCov
Matrix: Internal / UT & CodeCov
Matrix: Router / UT & CodeCov
Matrix: Server / UT & CodeCov
Matrix: StaticAnalysis
ValidateGradleWrapper
13s
StaticAnalysisAndUnitTestsFailureAlert
0s
Annotations
4 errors
|
InstanceSizeEstimatorTest.testInstanceMeasurement:
internal/venice-common/src/test/java/com/linkedin/venice/memory/InstanceSizeEstimatorTest.java#L49
java.lang.AssertionError: Memory allocated is negative! memoryAllocatedBeforeInstantiations: 2436449984; memoryAllocatedAfterInstantiations: 2432418104; memoryAllocatedByInstantiations: -4031880; 3 attempts left.
|
|
InstanceSizeEstimatorTest.testInstanceMeasurement:
internal/venice-common/src/test/java/com/linkedin/venice/memory/InstanceSizeEstimatorTest.java#L49
java.lang.AssertionError: Memory allocated is negative! memoryAllocatedBeforeInstantiations: 2436449984; memoryAllocatedAfterInstantiations: 2432418104; memoryAllocatedByInstantiations: -4031880; 3 attempts left.
|
|
SITWithPWiseWithoutBufferAfterLeaderTest.testDataValidationCheckPointing[1](UNSORTED, AA_ON):
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithPWiseWithoutBufferAfterLeaderTest.java#L1
Wanted but not invoked:
logNotifier.completed(
"TestTopic_4493aecd08_d988e547_v1",
1,
<Capturing argument>,
"STANDBY"
);
-> at com.linkedin.davinci.notifier.LogNotifier.completed(LogNotifier.java:27)
However, there were exactly 824 interactions with this mock:
logNotifier.started(
"TestTopic_4493aecd08_d988e547_v1",
1
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportStarted$1(IngestionNotificationDispatcher.java:117)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{2}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{3}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{4}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{5}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{6}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{7}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{8}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{9}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{10}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{11}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{12}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{13}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{14}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{15}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{16}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$re
|
|
SITWithPWiseWithoutBufferAfterLeaderTest.testDataValidationCheckPointing[1](UNSORTED, AA_ON):
clients/da-vinci-client/src/test/java/com/linkedin/davinci/kafka/consumer/SITWithPWiseWithoutBufferAfterLeaderTest.java#L1
Wanted but not invoked:
logNotifier.completed(
"TestTopic_4493aecd08_d988e547_v1",
1,
<Capturing argument>,
"STANDBY"
);
-> at com.linkedin.davinci.notifier.LogNotifier.completed(LogNotifier.java:27)
However, there were exactly 824 interactions with this mock:
logNotifier.started(
"TestTopic_4493aecd08_d988e547_v1",
1
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportStarted$1(IngestionNotificationDispatcher.java:117)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{2}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{3}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{4}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{5}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{6}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{7}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{8}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{9}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{10}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{11}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{12}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{13}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{14}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{15}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$reportProgress$10(IngestionNotificationDispatcher.java:214)
logNotifier.progress(
"TestTopic_4493aecd08_d988e547_v1",
1,
InMemoryPubSubPosition{16}
);
-> at com.linkedin.davinci.kafka.consumer.IngestionNotificationDispatcher.lambda$re
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
StaticAnalysis
|
951 KB |
sha256:312d23c72a344cfec2b58414e833affe305983bb5d644b08a660c6d007dc3a1c
|
|
|
clients-jdk11
|
3.23 MB |
sha256:356f9856e0b84cd2e4d5f5c52a6059b641d02b1c5ffeae83aacb9407da137eee
|
|
|
clients-jdk17
|
3.25 MB |
sha256:40d889d6f9b36b64163beeda15907c816c37eec88ee93407e1f119f89d7432e7
|
|
|
clients-jdk8
|
3.19 MB |
sha256:a43dc40315f0da5621d8c52307d451b69a360b118a6ae4da7ed5e1d186991902
|
|
|
controller-jdk11
|
1.97 MB |
sha256:ebe4b38a49f12867d399d63116229a196768be38d191e0eddddc2279221f676a
|
|
|
controller-jdk17
|
1.98 MB |
sha256:4636b31ff902f100064b0689851d92798ebfa4faf62190a0273884dd6c1098ae
|
|
|
controller-jdk8
|
1.96 MB |
sha256:fadf50a026c3e0a4a6dfe5296dd6abd11ba32b590f84a318577b97ef0e49c71b
|
|
|
integrations-jdk11
|
573 KB |
sha256:1252eb9b9275a5f043f2f5fde4e01a7916c89889856124c5dc0918a8daf18854
|
|
|
integrations-jdk17
|
578 KB |
sha256:c969a7de5ab9dc0e0ad471bbdea117729532adc41e181e1f13362a72c02b8a24
|
|
|
integrations-jdk8
|
559 KB |
sha256:56c0422741361fcc6f92a011f9bb0d00cebac4b8aff8219db79e8f4688cb54cb
|
|
|
internal-jdk11
|
4.27 MB |
sha256:e2b9715d9a914a5c1de4487dca3a095ceea41125b4268bfd8293436e53031d34
|
|
|
internal-jdk17
|
4.28 MB |
sha256:1b4754d12c237997a71b2f548ba388ae379fa9f14ef98535bb4220b47203989a
|
|
|
internal-jdk8
|
4.25 MB |
sha256:f886524ca56c80aac458403a1373e4083357b5dbd5f03250a16377e05ce828dd
|
|
|
router-jdk11
|
763 KB |
sha256:bad24e7b7e3db5fc1ba0e1cc78b26dec9523888d0b0e783512576504151f076e
|
|
|
router-jdk17
|
763 KB |
sha256:1fc11266c571d2e5f7ca9835a6d59535bd03911c234b8b58fb3a339615e61b1a
|
|
|
router-jdk8
|
752 KB |
sha256:79bc3a996d399ccd8a6655146be9aefa5668bb50a0fa45763587137b1112d8c1
|
|
|
server-jdk11
|
10.3 MB |
sha256:8743fd8aa16b58940ffbae0ea21893e9bcccef0da767034c7918d45df6e70468
|
|
|
server-jdk17
|
11 MB |
sha256:3aca85c28fbff2feee28cd99b841ef771b33d9e3400f06515fb2f0058b14a21a
|
|
|
server-jdk8
|
10.4 MB |
sha256:45cd4712157044f15e7820d3def5240cb3ddbca05966e48f7dd5122c1aa3fe61
|
|