Skip to content

Fix flaky test

Fix flaky test #947

GitHub Actions / IntegrationTests_9 Test Reports succeeded Nov 24, 2025 in 1s

84 passed, 2 failed and 0 skipped

Tests failed

Report Passed Failed Skipped Time
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment.xml 9✅ 39s
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.PushJobDetailsTest.xml 4✅ 458s
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions.xml 2✅ 162s
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml 11✅ 1❌ 557s
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest.xml 8✅ 3s
IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.helix.TestHelixExternalViewRepository.xml 8✅ 51s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment.xml 9✅ 39s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.PushJobDetailsTest.xml 4✅ 458s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions.xml 2✅ 162s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml 11✅ 1❌ 557s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest.xml 8✅ 3s
internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.helix.TestHelixExternalViewRepository.xml 8✅ 51s

✅ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment.xml

9 tests were completed in 39s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment 9✅ 39s

✅ com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment

✅ testAbortMigrationStoreDeletion
✅ testControllerFailOver
✅ testDeadStoreStatsInitialization
✅ testExternalViewDataChangeDeadLock
✅ testGetFutureVersionsNotBlocked
✅ testGetLeaderController
✅ testIdempotentStoreDeletion
✅ testStoreLifecycleValidateDeleted_WithLeftoverTopics
✅ testStoreLifecycle_ValidateDeleted

✅ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.PushJobDetailsTest.xml

4 tests were completed in 458s with 4 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.PushJobDetailsTest 4✅ 458s

✅ com.linkedin.venice.endToEnd.PushJobDetailsTest

✅ testPushJobDetails[0](false, false)
✅ testPushJobDetails[2](true, false)
✅ testPushJobDetails[4](false, true)
✅ testPushJobDetails[6](true, true)

✅ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions.xml

2 tests were completed in 162s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions 2✅ 162s

✅ com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions

✅ testDeferredVersionSwapWithFailedPushInTargetRegions
✅ testDvcDelayedIngestionWithFailingPushInTargetRegion

❌ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml

12 tests were completed in 557s with 11 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestStoreMigration 11✅ 1❌ 557s

❌ com.linkedin.venice.endToEnd.TestStoreMigration

✅ testAutoStoreMigration
✅ testStoreMigration
✅ testStoreMigrationAfterFailedAttempt
✅ testStoreMigrationForFastClient
❌ testStoreMigrationStaleKillIngestionMessageDeletion
	java.lang.AssertionError: Kill message found in participant store: venice_system_store_participant_store_cluster_venice-cluster1 for topic: testWithFailedAttempt_e5e51d8744_29c3594a_v1 expected [null] but found [{"messageType": 0, "messageUnion": {"timestamp": 1764011191216}}]
✅ testStoreMigrationWithDaVinciPushStatusSystemStore
✅ testStoreMigrationWithMetaSystemStore
✅ testStoreMigrationWithNewPushesAndUpdates
✅ testStoreMigrationWithPushJobTrackingVTInParentRegion
✅ testStoreMigrationWithStoreConfigs
✅ testVersionConfigsRemainSameAfterStoreMigration
✅ testStoreMigrationStaleKillIngestionMessageDeletion

✅ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest.xml

8 tests were completed in 3s with 8 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest 8✅ 3s

✅ com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest

✅ testBatchGetGenericClient[0](false, SERVER_BASED_METADATA)
✅ testBatchGetGenericClient[2](true, SERVER_BASED_METADATA)
✅ testBatchGetSpecificClient[0](SERVER_BASED_METADATA)
✅ testStreamingBatchGetGenericClient[0](false, SERVER_BASED_METADATA)
✅ testStreamingBatchGetGenericClient[2](true, SERVER_BASED_METADATA)
✅ testStreamingBatchGetLimit
✅ testStreamingBatchGetWithCallbackGenericClient[0](false, SERVER_BASED_METADATA)
✅ testStreamingBatchGetWithCallbackGenericClient[2](true, SERVER_BASED_METADATA)

✅ IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.helix.TestHelixExternalViewRepository.xml

8 tests were completed in 51s with 8 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.helix.TestHelixExternalViewRepository 8✅ 51s

✅ com.linkedin.venice.helix.TestHelixExternalViewRepository

✅ testControllerChanged
✅ testGetInstances
✅ testGetNumberOfPartitions
✅ testGetNumberOfPartitionsWhenResourceDropped
✅ testGetPartitions
✅ testListeners
✅ testNodeChanged
✅ testPartitionMove

✅ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment.xml

9 tests were completed in 39s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment 9✅ 39s

✅ com.linkedin.venice.controller.TestVeniceHelixAdminWithIsolatedEnvironment

✅ testAbortMigrationStoreDeletion
✅ testControllerFailOver
✅ testDeadStoreStatsInitialization
✅ testExternalViewDataChangeDeadLock
✅ testGetFutureVersionsNotBlocked
✅ testGetLeaderController
✅ testIdempotentStoreDeletion
✅ testStoreLifecycleValidateDeleted_WithLeftoverTopics
✅ testStoreLifecycle_ValidateDeleted

✅ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.PushJobDetailsTest.xml

4 tests were completed in 458s with 4 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.PushJobDetailsTest 4✅ 458s

✅ com.linkedin.venice.endToEnd.PushJobDetailsTest

✅ testPushJobDetails[0](false, false)
✅ testPushJobDetails[2](true, false)
✅ testPushJobDetails[4](false, true)
✅ testPushJobDetails[6](true, true)

✅ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions.xml

2 tests were completed in 162s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions 2✅ 162s

✅ com.linkedin.venice.endToEnd.TestDeferredVersionSwapWithFailingRegions

✅ testDeferredVersionSwapWithFailedPushInTargetRegions
✅ testDvcDelayedIngestionWithFailingPushInTargetRegion

❌ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml

12 tests were completed in 557s with 11 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestStoreMigration 11✅ 1❌ 557s

❌ com.linkedin.venice.endToEnd.TestStoreMigration

✅ testAutoStoreMigration
✅ testStoreMigration
✅ testStoreMigrationAfterFailedAttempt
✅ testStoreMigrationForFastClient
❌ testStoreMigrationStaleKillIngestionMessageDeletion
	java.lang.AssertionError: Kill message found in participant store: venice_system_store_participant_store_cluster_venice-cluster1 for topic: testWithFailedAttempt_e5e51d8744_29c3594a_v1 expected [null] but found [{"messageType": 0, "messageUnion": {"timestamp": 1764011191216}}]
✅ testStoreMigrationWithDaVinciPushStatusSystemStore
✅ testStoreMigrationWithMetaSystemStore
✅ testStoreMigrationWithNewPushesAndUpdates
✅ testStoreMigrationWithPushJobTrackingVTInParentRegion
✅ testStoreMigrationWithStoreConfigs
✅ testVersionConfigsRemainSameAfterStoreMigration
✅ testStoreMigrationStaleKillIngestionMessageDeletion

✅ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest.xml

8 tests were completed in 3s with 8 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest 8✅ 3s

✅ com.linkedin.venice.fastclient.BatchGetAvroStoreClientTest

✅ testBatchGetGenericClient[0](false, SERVER_BASED_METADATA)
✅ testBatchGetGenericClient[2](true, SERVER_BASED_METADATA)
✅ testBatchGetSpecificClient[0](SERVER_BASED_METADATA)
✅ testStreamingBatchGetGenericClient[0](false, SERVER_BASED_METADATA)
✅ testStreamingBatchGetGenericClient[2](true, SERVER_BASED_METADATA)
✅ testStreamingBatchGetLimit
✅ testStreamingBatchGetWithCallbackGenericClient[0](false, SERVER_BASED_METADATA)
✅ testStreamingBatchGetWithCallbackGenericClient[2](true, SERVER_BASED_METADATA)

✅ internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.helix.TestHelixExternalViewRepository.xml

8 tests were completed in 51s with 8 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.helix.TestHelixExternalViewRepository 8✅ 51s

✅ com.linkedin.venice.helix.TestHelixExternalViewRepository

✅ testControllerChanged
✅ testGetInstances
✅ testGetNumberOfPartitions
✅ testGetNumberOfPartitionsWhenResourceDropped
✅ testGetPartitions
✅ testListeners
✅ testNodeChanged
✅ testPartitionMove

Annotations

Check failure on line 911 in internal/venice-test-common/src/integrationTest/java/com/linkedin/venice/endToEnd/TestStoreMigration.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_9 Test Reports

com.linkedin.venice.endToEnd.TestStoreMigration ► testStoreMigrationStaleKillIngestionMessageDeletion

Failed test found in:
  IntegrationTests_9-artifacts/internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml
  internal/venice-test-common/build/test-results/integrationTests_9/TEST-com.linkedin.venice.endToEnd.TestStoreMigration.xml
Error:
  java.lang.AssertionError: Kill message found in participant store: venice_system_store_participant_store_cluster_venice-cluster1 for topic: testWithFailedAttempt_e5e51d8744_29c3594a_v1 expected [null] but found [{"messageType": 0, "messageUnion": {"timestamp": 1764011191216}}]
Raw output
java.lang.AssertionError: Kill message found in participant store: venice_system_store_participant_store_cluster_venice-cluster1 for topic: testWithFailedAttempt_e5e51d8744_29c3594a_v1 expected [null] but found [{"messageType": 0, "messageUnion": {"timestamp": 1764011191216}}]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotSame(Assert.java:772)
	at org.testng.Assert.assertNull(Assert.java:708)
	at com.linkedin.venice.endToEnd.TestStoreMigration.lambda$verifyKillMessageInParticipantStore$28(TestStoreMigration.java:911)
	at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:287)
	at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:272)
	at com.linkedin.venice.endToEnd.TestStoreMigration.verifyKillMessageInParticipantStore(TestStoreMigration.java:903)
	at com.linkedin.venice.endToEnd.TestStoreMigration.testStoreMigrationStaleKillIngestionMessageDeletion(TestStoreMigration.java:685)