Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
791 commits
Select commit Hold shift + click to select a range
940fd35
[router] Add a dedicated executor for SSL handshakes in routers (#949)
nisargthakkar Apr 19, 2024
5a687d9
[cc] Expose partitionCount from VeniceChangelogConsumer (#948)
kcepmada Apr 19, 2024
987595b
[dvc] Add experimental annotation to DaVinciRecordTransformer, and ad…
kvargha Apr 22, 2024
b25d212
[fast-client] Long tail retry budget for fast client (#930)
xunyin8 Apr 22, 2024
d881e26
[changelog] Fix after-image change capture client dropping record iss…
sixpluszero Apr 22, 2024
13e8c49
[server][da-vinci] Introduced a new mode to disable record-level metr…
gaojieliu Apr 23, 2024
f098732
Add heartbeat lag metrics to change capture client (#955)
ZacAttack Apr 23, 2024
75b68b5
[admin-tool] Enable decompression in admin tool topic dumper (#959)
nisargthakkar Apr 24, 2024
dde97f5
[dvc][server] IDE suggested cleanups (#951)
FelixGV Apr 24, 2024
078ff60
[doc] Added link to contributor's guide (#960)
eldernewborn Apr 24, 2024
74d6a19
[doc] Standardize and fix links in docs (#961)
nisargthakkar Apr 24, 2024
d8c700e
[router][server][alpini] Add support for IdentityParser in SslInitial…
nisargthakkar Apr 24, 2024
1b277a6
[controller] Dont call backup version cleanup service on stores witho…
majisourav99 Apr 25, 2024
fc31ea4
[da-vinci][server] Don't resume record-level metrics if the subscript…
gaojieliu Apr 26, 2024
ba9a6a7
[dvc][server]Enable leader complete status check for non Active-Activ…
m-nagarajan Apr 27, 2024
d2ddd1c
[vpj] Do not mark overall status COMPLETE till all region finishes (#…
majisourav99 Apr 29, 2024
ddd1b1e
[server] - Fix consumer leaks in TM that occur when the thread owning…
sushantmane Apr 30, 2024
da82ba8
[vpj] Fix building or fetching dictionary for repush jobs (#971)
nisargthakkar Apr 30, 2024
1bd3b09
[vpj] Skip closing the SparkSession and let it be closed at app shutd…
nisargthakkar Apr 30, 2024
eade77a
[changelog] Let bootstrapping changelog consumer consumes after-image…
sixpluszero Apr 30, 2024
b2301ac
[admin-tool] Fixed mishandling of get store response in store migrati…
xunyin8 May 1, 2024
05836eb
[router] Added config to enable DNS resolution before SSL (#970)
huangminchn May 1, 2024
054ea3f
[controller] Do not delete parent VT for target colo batch push (#964)
majisourav99 May 1, 2024
7df577e
[server] Make separate drainer for batch and hybrid store ingestions …
majisourav99 May 1, 2024
40ed887
[server][da-vinci] Log VersionTopic offset when logging lossy rewind …
huangminchn May 1, 2024
d7997d7
[Controller][all] Do not truncate Kafka topic immediately for fatal d…
lluwm May 6, 2024
4b5e4ff
[controller] Fix multiple AdminExecutionTasks working on the same sto…
haoxu07 May 8, 2024
02591a1
[server][da-vinci] Bumped RocksDB dep and adopt multiget async io by …
gaojieliu May 9, 2024
74f0724
[vpj] Do not enable target region push for deferred version swap stor…
majisourav99 May 9, 2024
ba0d7fa
[changelog] Multiple fixes to changelog consumer logic (#977)
sixpluszero May 9, 2024
db36ee2
[fast-client][server] Throw 403 for metadata request that does not ha…
xunyin8 May 13, 2024
ff284d4
[admin-tool] Make cluster argument optional in Admin tool where possi…
nisargthakkar May 14, 2024
5c0e66a
[test] Fix for cross-test interrupt contamination (#986)
FelixGV May 15, 2024
0a19839
[server] Lag monitor should not expect corresponding version always e…
xunyin8 May 16, 2024
53b39bf
[server] Revert lossy rewind criterion to EOP from completion reporti…
sushantmane May 16, 2024
c778d63
[controller] Do not delete true backup version during Repush (#945)
majisourav99 May 17, 2024
9bf4260
[server] Feature to tune level0 compaction tuning for read-write lead…
gaojieliu May 20, 2024
bf00dac
[client][internal] Fix tests related to PR#975 (#995)
mynameborat May 21, 2024
2ecfa83
[dvc][server][controller][router] Removed Optional from Store API (#990)
FelixGV May 21, 2024
d0f931b
[controller] Check only parent colo store defered swap config (#994)
majisourav99 May 21, 2024
0a64bf4
[controller] CI build fix (#997)
majisourav99 May 21, 2024
2720a83
[common][server] Bug fixes and clean of ACL handlers for GRPC (#982)
mynameborat May 22, 2024
acbf04a
[vpj] Fix file system on spark push job (#999)
modithah May 22, 2024
d9cc66b
[davinci] PartitionTracker code cleanup (#996)
lluwm May 23, 2024
1f3c017
[internal][client] Support GRPC port discovery for non-local environm…
mynameborat May 23, 2024
d46fd2b
[server] clean up DIV metrics and fix broken ones (#993)
adamxchen May 24, 2024
5d68078
[controller] Muted exception from a log in VHA::hasFatalDataValidatio…
FelixGV May 26, 2024
49d2880
[Controller] Fixed superset schema generation issue (#1001)
gaojieliu May 28, 2024
f07b535
[CI] Update some Github Action versions (#1005)
adamxchen May 29, 2024
13864f8
[CI] bump the code coverage (#1006)
adamxchen May 29, 2024
f6f0546
[server][dvc] Adopt standard logging format for topic-partition/repli…
sushantmane May 29, 2024
35c027e
[controller] Fix a bug in deleteOneStoreVersion (#1007)
lluwm May 30, 2024
ecff0f9
[server][da-vinci] Fixed lossy rewind logging bug (#1008)
huangminchn May 30, 2024
628361c
[controller][server] Add metric to track pub-sub admin operation fail…
sushantmane May 31, 2024
538fb6a
[controller] Support dangling topic check and deletion in topic clean…
haoxu07 May 31, 2024
a04a92c
[server] Add retries for topic existence checks in SIT (#1003)
sushantmane May 31, 2024
c98883d
[router] Delete dictionary for retired versions instead of existing v…
huangminchn May 31, 2024
4854617
[CI] Correct package name in CI test bucketing logic for accurate buc…
sushantmane May 31, 2024
e95a269
[fast-client] IndexOutOfBoundsException in getReplicas due to bad cas…
xunyin8 Jun 4, 2024
6327449
[specs][doc] FizzBee spec for the Venice's LeaderFollower protocol (#…
jayaprabhakar Jun 5, 2024
d678216
[router] Set default config value to limit long tail retries to 2 (#1…
majisourav99 Jun 5, 2024
53767c0
[changelog] Add isCaughtUp() API to VeniceChangelogConsumer interface…
sixpluszero Jun 5, 2024
43ba140
[dvc][server][vpj][producer][controller] Refactored VeniceWriter's cl…
FelixGV Jun 6, 2024
7798479
[common][client-common] high level blob transfer manager interface (#…
adamxchen Jun 6, 2024
e68caf6
[all] Make getValueSchemaId APIs match the canonical schemas (#1018)
nisargthakkar Jun 7, 2024
a341a94
[vpj] Fix user-friendly partial update mode in Spark (#1021)
nisargthakkar Jun 8, 2024
ba779e2
[build] Bump minor version when patch versions reach 100 (#1023)
nisargthakkar Jun 8, 2024
4c52343
Revert "[build] Bump minor version when patch versions reach 100" (#1…
nisargthakkar Jun 9, 2024
8e78b81
[common] Add version signature to the blob manager interface (#1022)
adamxchen Jun 10, 2024
e382726
[server] Fully Assembled Record Size Metric (#1009)
KaiSernLim Jun 10, 2024
d37e6a9
[dvc] dvc node blob discovery (#980)
ishwarya-citro Jun 10, 2024
4082a43
[vpj] Unify shared temp directories for VPJ (#1025)
nisargthakkar Jun 10, 2024
0cda422
[server] Remove Server Ingestion Isolation implementation (#1029)
sixpluszero Jun 13, 2024
835efd2
[vpj] Remove extra call to PubSub to fetch partition count for data w…
nisargthakkar Jun 13, 2024
f8f8620
[controller] Do not call metadata store in parent controller (#1026)
majisourav99 Jun 14, 2024
2935c8d
[dvc] Invoke lifecycle methods in StoreIngestionTask for RecordTransf…
kvargha Jun 14, 2024
6c99f07
[server][davinci] Created interface for Blob discovery and added a se…
sebas-inf Jun 14, 2024
220cab7
[test] Fix Flaky testAssembledValueSizeSensor Unit Test (#1031)
KaiSernLim Jun 14, 2024
f6b6a10
[server] Log region name in DIV log messages (#1038)
sushantmane Jun 18, 2024
72d4dc4
[vpj][controller] Fix mismatch in per colo status reporting and overa…
m-nagarajan Jun 18, 2024
6b2ff8d
[all] Remove Amplification Factor implementation in ingestion logics …
sixpluszero Jun 18, 2024
35af4b0
[router] Do not mark storage node fast for TOO_MANY_REQUESTS(429) (#1…
majisourav99 Jun 21, 2024
7552d46
[server] Do not consult data replication policy for lag measurement i…
sushantmane Jun 21, 2024
ef4000d
[common] Add Netty based P2P lib for blob transfer (#1041)
adamxchen Jun 21, 2024
c602d2b
[dvc] Ensure onStartIngestionTask in DaVinciRecordTransformer (DVRT) …
kvargha Jun 24, 2024
9f6b5f1
[docker] Update venice docker image versions in quick start guides (#…
sushantmane Jun 25, 2024
d9e2cf9
[controller] [admin-tool] Max Record Size Config (#1027)
KaiSernLim Jun 25, 2024
f17e000
[controller][server][client][test] Adds a new checksum type ADHASH fo…
lluwm Jun 25, 2024
0ddf4f2
[client][davinci]Blob Snapshot Manager (#1039)
sebas-inf Jun 26, 2024
c81f413
[doc] Update open-source docs to make getting started easier (#1051)
kvargha Jun 27, 2024
7c582e6
[controller] Delete backup version before start of new push in target…
majisourav99 Jun 27, 2024
1894f95
[test] Fixed unit test related to multi threading (#1054)
sebas-inf Jun 28, 2024
4ba73c9
[admin-tool] Venice-specific path filtering logic for ZooKeeper Snaps…
bonytoni Jul 9, 2024
3bb03f5
Query blob discovery bootstrap (#1046)
ishwarya-citro Jul 11, 2024
9af4947
[controller] Improved the perf of DaVinci push status polling for inc…
gaojieliu Jul 11, 2024
129dbfa
[test] remove unnecessary blob transfer feature flags from tests (#1060)
ishwarya-citro Jul 12, 2024
f9af2bf
Revert "[server][da-vinci] Bumped RocksDB dep and adopt multiget asyn…
gaojieliu Jul 15, 2024
adbc590
[router] Fix NPE in ScatterGatherRequestHandlerImpl (#1044)
atcurtis Jul 15, 2024
9c65bc8
[admin-tool] Make end-date arg optional in query-kafka-topic (#1064)
nisargthakkar Jul 15, 2024
65a92eb
[controller] Avoid NPE in DIV check during kill-job (#1065)
nisargthakkar Jul 16, 2024
0b33e23
[controller] Check deferred version swap flag before lingering push (…
majisourav99 Jul 16, 2024
a14900c
[router] Fix MultiSchemaResponse fetch in metadata handler (#1068)
majisourav99 Jul 17, 2024
979fd05
[test][controller] Fix multi-region tests to use VeniceTwoLayerMultiR…
nisargthakkar Jul 17, 2024
620ee8d
[controller] Merge VeniceControllerConfig and VeniceControllerCluster…
nisargthakkar Jul 22, 2024
cd7889d
[dvc][test] Fix missing parts for blob transfer and add one incomplet…
adamxchen Jul 23, 2024
30896b1
[server] Fix error in repush with DELETE in AASIT (#1074)
sixpluszero Jul 23, 2024
786b302
[venice-thin-client] Allow refresh while fetching value from router (…
majisourav99 Jul 23, 2024
22a3b29
[vpj] [controller] Enforce Record Size Limit on Batch Push Jobs (#1052)
KaiSernLim Jul 23, 2024
79a13ba
[admin-tool] Metadata migration from source ZK to destination ZK (#1056)
bonytoni Jul 23, 2024
e348008
[config] Changed parameter to allow for blob transfer (#1078)
sebas-inf Jul 24, 2024
f95f663
[admin-tool]Modified integration test for blob-transfer (#1080)
sebas-inf Jul 24, 2024
df1e78b
[controller][admin-tool][vpj][test] Add a multi-region config to cont…
nisargthakkar Jul 25, 2024
4a20cdf
[router][common][fast-client] Add RetryManager to venice-router (#1058)
xunyin8 Jul 26, 2024
d0f86ff
[server] Fix a race condition in SIT graceful shutdown workflow (#1083)
lluwm Jul 26, 2024
decc833
[test] Make some tests in TestAdminSparkServer less flaky (#1085)
nisargthakkar Jul 29, 2024
cdbd176
[controller] Checking parent controller region state before handling …
bonytoni Jul 29, 2024
4a2e565
[vpj][server] Fix DELETE handling in TTL repush and allow server to a…
sixpluszero Jul 31, 2024
0b6b41d
[da-vinci] Added a speedup throttler when DaVinci is bootstrapping cu…
gaojieliu Aug 1, 2024
0f250df
[controller] Delete leaking backup versions from repush (#1084)
majisourav99 Aug 2, 2024
1cc259a
[server] Pass ingestion role change for store version from StoreInges…
haoxu07 Aug 2, 2024
f43ec45
[controller] Add retry thread for serviceDiscoveryAnnouncers that fai…
bonytoni Aug 2, 2024
cf6ebd2
[da-vinci]Fixed a bug in DaVinci bootstrapping mode (#1097)
gaojieliu Aug 5, 2024
1c3b884
[test] Fix store migration test flakiness (#1098)
xunyin8 Aug 5, 2024
233c893
[server] Fixed ServerStoreAclHandler unable to process DICTIONARY que…
xunyin8 Aug 6, 2024
e606214
[router] Drain in-flight requests for graceful router shutdown (#1092)
majisourav99 Aug 6, 2024
9fd26f8
[changelog] Add version consumption metric and old offset exception t…
ZacAttack Aug 6, 2024
78f869e
[da-vinci][router] Fix for router related issues on DaVinci Blob-Tran…
sebas-inf Aug 7, 2024
5fd3905
[server] Ratio Metric for Max Record Size (#1077)
KaiSernLim Aug 8, 2024
b6c08c5
[controller] Remove stale kill messages from destination cluster bef…
sushantmane Aug 8, 2024
139d733
[vpj] Use native Spark readers for reading from Avro and VSON files (…
nisargthakkar Aug 8, 2024
654dac6
[controller] Deprecate ACTIVE_ACTIVE data replication policy (#1045)
sushantmane Aug 8, 2024
b85ac9c
[server][dvc] tweak logging for server (#1055)
adamxchen Aug 8, 2024
ae8d54f
[router] NPE fix for ReadRequestThrottler constructor/listener (#1103)
FelixGV Aug 9, 2024
0ad2fe1
[da-vinci] Open RocksDB after blob transfer is completed (#1105)
sebas-inf Aug 9, 2024
7dfa6b3
[server] Add version topic information to topic partition ingestion c…
haoxu07 Aug 9, 2024
75454f3
Bump Jackson Version to 2.13.4 (#1109)
sixpluszero Aug 9, 2024
193f012
[thin-client] Do not print key/value info in log (#1106)
majisourav99 Aug 9, 2024
6cae6b7
[vpj][server][samza][admin-tool][controller] Added parent controller …
bonytoni Aug 9, 2024
60b13a4
[test] Add support to specify Zk base path in tests (#1112)
nisargthakkar Aug 12, 2024
03a4172
[server] Use chunk manifest schema id for writer when performing upda…
ZacAttack Aug 12, 2024
fca2592
[server] Fix server side connection tracking and logging (#1113)
sushantmane Aug 13, 2024
95bf948
[fast-client] Added fanout size metric for FC to monitor multi-key HA…
xunyin8 Aug 13, 2024
2a2f3e9
[server] Supporting 4 consumer pools for current version and isolatio…
haoxu07 Aug 14, 2024
402383a
[doc] Venice Large Record Value Chunking Diagram (#1107)
KaiSernLim Aug 14, 2024
f41c437
[fast-client] Make multi-key retry budget enforce at key level in FC …
xunyin8 Aug 15, 2024
9241e8b
[da-vinci][test]Modified Integration Test for DVC Blob Transfer (#1118)
sebas-inf Aug 16, 2024
bedd9c0
[server] Added throttlers for different kinds of consumer pool (#1102)
gaojieliu Aug 16, 2024
14d0b2e
[fast-client] Fixed request banding issue and request id generator (#…
gaojieliu Aug 16, 2024
6d8556f
[server] print out slow consumer thread backtrace (#1120)
lluwm Aug 16, 2024
7ee184e
[controller][router][server][da-vinci] Pull jacksonCore into venice-c…
huangminchn Aug 17, 2024
4c93ae2
[server][test] Add integration test for thread pool jumping by enabli…
haoxu07 Aug 19, 2024
c9304b2
[fast-client][router] Fixed one slow start issue (#1125)
gaojieliu Aug 19, 2024
7789cb4
[vpj] Exclude jackson dependency from HDFS dependency (#1126)
huangminchn Aug 19, 2024
0ae9e6a
[test] Microbenchmark for TokenBucket (#1122)
FelixGV Aug 20, 2024
ed851aa
[vpj] Revert using native Spark readers for reading from Avro and VSO…
huangminchn Aug 20, 2024
d818b57
[server] Reuse resource names and URI object during server read reque…
majisourav99 Aug 21, 2024
ba6184a
[server][da-vinci] Bug fix: unsorted drainer service metrics failed t…
huangminchn Aug 22, 2024
83797a2
[server] Add metric to verifying current version prioritization strat…
haoxu07 Aug 24, 2024
a8093a1
[doc] Add 2024 Video Links (#1144)
KaiSernLim Aug 27, 2024
aea19bf
[server][router] flush latency/response size metrics in Server and HB…
gaojieliu Aug 28, 2024
07fd327
[dvc] Fixed DVC integration test resource leak (#1147)
FelixGV Aug 29, 2024
162e4f9
[Specs] Add TLA+ Specification for a Bounded Collection Operation (#1…
ZacAttack Aug 30, 2024
c8d0531
[da-vinc-client] DVC aggregates push status updates across partitions…
huangminchn Aug 30, 2024
c8b95ab
[fc] Fix fast client multiget metrics to use the right context (#1140)
m-nagarajan Sep 2, 2024
fa27ef0
[server] [controller] [admin-tool] Max Nearline Record Size Config (#…
KaiSernLim Sep 3, 2024
9276f5a
[controller] Remove older backup versions after retention period (#1…
majisourav99 Sep 4, 2024
fd45050
[fast-client][thin-client] Common headers and metrics logic between t…
xunyin8 Sep 4, 2024
8d220c5
[router][samza] Harden up quota monitor requests (#1148)
ZacAttack Sep 4, 2024
4fdaac5
[server][metrics] Add new metric which distinguishes a serving partit…
ZacAttack Sep 4, 2024
ba6ead3
[controller] Fail hybrid store conversion if a pushjob is running (#1…
majisourav99 Sep 4, 2024
31a442c
[server] Refactor ReadQuotaEnforcementHandler to reduce code duplicat…
sushantmane Sep 5, 2024
c7cf596
[server] Handle unnecessary logging for non-existent consumer checkin…
haoxu07 Sep 5, 2024
ec3ce13
[davinci][trivial] Increase log levels for skipped operations in proc…
lluwm Sep 5, 2024
9b765b4
[vpj] Support AAWC TTL repush with compression (#1155)
sixpluszero Sep 5, 2024
38da506
[server] SN read quota usage should return NaN for stores with no rep…
xunyin8 Sep 5, 2024
a0d5909
[server][dvc] Server request/response handling overhaul (#1152)
FelixGV Sep 5, 2024
a7bcbd5
[server] Fail-Fast on Corrupted OffsetRecord (#1150)
KaiSernLim Sep 6, 2024
96e6512
Fix flaky test of `testEnablePartialUpdateOnActiveActiveStore` due to…
haoxu07 Sep 6, 2024
4b1dfd4
[server] AAWC should ignore NO_OP new field from update record (#1159)
sixpluszero Sep 6, 2024
9494b43
[Server][FC] throws exception during store migration to enforce d2 re…
adamxchen Sep 7, 2024
35c1ec1
[vpj] [common] [da-vinci] Refactor schema source venice-common to con…
mynameborat Sep 9, 2024
a782eee
[server][controller][router] Minor cleanups (#1161)
FelixGV Sep 9, 2024
d4bf2ba
[server] Make rate limiter configurable in quota enforcement handler …
sushantmane Sep 10, 2024
74e5e82
[common] Retry controller client request on exceptions (#1165)
majisourav99 Sep 11, 2024
233d3fd
[fast-client][router] Revert "[fast-client][router] Fixed one slow st…
huangminchn Sep 11, 2024
7e66fd3
[server][dvc] generate snapshot after endBatchWrite complete (#1162)
jingy-li Sep 11, 2024
d569a5a
[all] Upgrade helix lib dependency to 1.4.1 (#1050)
majisourav99 Sep 11, 2024
c25c658
[dvc] Exposed an API to pass an executor to CachingDaVinciClientFacto…
gaojieliu Sep 11, 2024
64dba89
[da-vinci][fast-client] Delete deprecated NativeMetadataRepository an…
xunyin8 Sep 13, 2024
7310272
[doc][script] Automatically verify JDK version in gradle, and specify…
kvargha Sep 13, 2024
48b155c
[server] Batch report EOIP for incremental push prior to replica read…
sixpluszero Sep 13, 2024
1fc53dc
[server] Parallel processing for AA/WC workload (#1164)
gaojieliu Sep 16, 2024
37ea7b3
[router][venice-thin-client] Add safeguard against invalid schema ID …
majisourav99 Sep 17, 2024
7a37d02
[script] Explicitly tell the user to set their JAVA_HOME if their JDK…
kvargha Sep 17, 2024
eedc5d8
[server][router] Handle migrated store before checking ACL (#1175)
nisargthakkar Sep 17, 2024
21f4d23
[all] Minor code cleanup in various enums (#1182)
FelixGV Sep 17, 2024
7678a57
[vpj] Ignore field props check during subset schema validation. (#1180)
haoxu07 Sep 18, 2024
88e0f5b
[spark] [hadoop] [vpj] Refactor to make spark a first class citizen o…
eldernewborn Sep 18, 2024
2b0ae24
[VPJ] More reorg for the venice-push-job module (#1186)
eldernewborn Sep 19, 2024
e684eaa
[build] Redistribute some of the integration test load to make things…
eldernewborn Sep 20, 2024
bd2de8e
[fast-client] Replace per-store per-route tracking by per-route track…
gaojieliu Sep 20, 2024
262101c
[common][server][dvc-client] Make a true non-blocking end-offset fetc…
majisourav99 Sep 20, 2024
5619993
[controller] Add support for controller instance tagging (#1190)
kvargha Sep 20, 2024
328d72a
[vpj][controller] Emit push job status metrics from controller (#1185)
m-nagarajan Sep 24, 2024
9b33502
[controller] Make setting instance group tags for controller cluster …
kvargha Sep 24, 2024
5d92c7d
[vpj] Use native Spark readers for reading from Avro and VSON files (…
nisargthakkar Sep 24, 2024
1df15f8
[controller] Set rebalancing strategy to Waged instead of Crush when …
kvargha Sep 24, 2024
939d655
[controller][compat] Controller part change for supporting separate r…
haoxu07 Sep 25, 2024
25d90a5
[server][dvc] transfer offsetRecord and storeVersionState during blob…
jingy-li Sep 25, 2024
93d86d8
[server] Added metrics to track batch processing perf (#1195)
gaojieliu Sep 26, 2024
c772dd3
Revert "[common][server][dvc-client] Make a true non-blocking end-off…
majisourav99 Sep 26, 2024
04aeaeb
[controller] Superset schema generation should reflect default value …
sixpluszero Sep 26, 2024
c694d96
[controller] Ensure empty string from config doesn't result in an arr…
kvargha Sep 27, 2024
b932806
[vpj][all] Create a new module for offline components to reduce leaka…
nisargthakkar Sep 28, 2024
6057b1f
[server] tweak heartbeat reporting to use completion check (#1207)
ZacAttack Sep 30, 2024
450613a
[vpj] Merge venice-hadoop-common back into VPJ (#1208)
nisargthakkar Sep 30, 2024
06cc1fc
[server] Race condition fix for re-subscription of real-time topic pa…
haoxu07 Sep 30, 2024
b9685bb
[da-vinci][controller] Filter out status reporting from the nodes, wh…
gaojieliu Oct 2, 2024
b04bcec
[server] integration test for blob transfer between servers (#1206)
jingy-li Oct 2, 2024
5231ed4
[controller] Add ability to configure cloud config for venice-control…
kvargha Oct 4, 2024
5889f63
[compat][da-vinci][test] Global RT DIV improvement (part 1): RT and V…
lluwm Oct 4, 2024
001f7a9
Revert "[server] Race condition fix for re-subscription of real-time …
gaojieliu Oct 7, 2024
0ea4e5c
[all] Bumped up the tehuti dep to the latest 0.12.3 (#1222)
m-nagarajan Oct 8, 2024
e53e684
[controller] fix topic priority determination in TopicCleanupService …
arjun4084346 Oct 8, 2024
47d987e
[server][common] Allow store config repo to fetch configs only when n…
adamxchen Oct 8, 2024
d65cb71
[vpj][common][dvc] Minor logging change (#1193)
majisourav99 Oct 8, 2024
6901820
[controller] Make PS3 incremental push status reads config cluster-sp…
sushantmane Oct 8, 2024
fe01543
[controller] add logs for push job status (#1225)
m-nagarajan Oct 9, 2024
53adf35
[server] Add option to disable incremental push status update writes …
sushantmane Oct 9, 2024
1ce7d5e
[controller] Stop writing writing ready-to-serve instances info in me…
sushantmane Oct 9, 2024
5cc32a7
[server][dvc] Retry/Skip hosts that fail to connect or transfer files…
jingy-li Oct 9, 2024
0cd9b9e
[controller] Fix bug where setting the cloud config was only done on …
kvargha Oct 10, 2024
14d05d4
[server][da-vinci-client] Retry non-blocking metadata fetch (#1232)
majisourav99 Oct 10, 2024
c967e2d
[test] Make sure meta store ready before DVC memory limiter test (#1233)
majisourav99 Oct 11, 2024
a1d33e4
[controller] Refresh OfflinePushStatus after change listener subscrip…
sixpluszero Oct 11, 2024
776149e
[server] Add ability to configure Helix InstanceOperation to UNKNOWN …
kvargha Oct 15, 2024
9a3f892
[changelog][dvc] Disable TC internal retry in ThinClientMetaStoreBase…
xunyin8 Oct 15, 2024
3d32d36
[controller][server][dvc][vpj][producer][consumer] Fixed sys store in…
FelixGV Oct 17, 2024
1262e0b
[changelog] Centralize pubsubconsumer assignment to synchronized coll…
ZacAttack Oct 17, 2024
9f468c3
[server] Incremental push status should not update replica current st…
sixpluszero Oct 17, 2024
073e61d
[common][controller] Introduce new VeniceView config: MaterializedVie…
xunyin8 Oct 17, 2024
1ebd6fa
[controller] Set min RF on controllers and storage clusters to RF - 1…
kvargha Oct 18, 2024
2bab676
[server] Increase retry limit in metadata fetch (#1241)
majisourav99 Oct 18, 2024
911f9be
[controller] Enable backend to do dual reads on DVC incremental push …
huangminchn Oct 18, 2024
5a6fb94
[server][dvc] support hybrid store in blob transfer with recreating s…
jingy-li Oct 21, 2024
a698f3e
[server] fix flaky test in blob transfer integration test (#1255)
jingy-li Oct 22, 2024
30999ea
[compat][server][controller] Introduced options to speed up KafkaProd…
gaojieliu Oct 25, 2024
28d3dee
Add buildpulse
sushantmane Oct 28, 2024
284775d
Test codecov for analytics
sushantmane Oct 28, 2024
82c50be
Add coverage reports
sushantmane Oct 28, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 2 additions & 0 deletions .git-blame-ignore-revs
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
43b8eb5ca60b708c6bc86a6a0c92df2d657af2c1
690830eb1aae03017aa43627128b4860e60eeab1
bb6544918fc3105a834782eb3c170711d5ba206c
63a7921da1c1814f9d856a6375f84ba392c01abb
9bd0175869cd66376457bdecf9e00583cfb98301
2 changes: 2 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report_template.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,8 @@ body:
required: false
- label: "`VenicePushJob`: This is the component that pushes derived data from Hadoop to Venice backend."
required: false
- label: "`VenicePulsarSink`: This is a Sink connector for Apache Pulsar that pushes data from Pulsar into Venice."
required: false
- label: "`Thin Client`: This is a stateless client users use to query Venice Router for reading store data."
required: false
- label: "`Fast Client`: This is a stateful client users use to query Venice Server for reading store data."
Expand Down
2 changes: 2 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request_template.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,8 @@ body:
required: false
- label: "`VenicePushJob`: This is the component that pushes derived data from Hadoop to Venice backend."
required: false
- label: "`VenicePulsarSink`: This is a Sink connector for Apache Pulsar that pushes data from Pulsar into Venice."
required: false
- label: "`Thin Client`: This is a stateless client users use to query Venice Router for reading store data."
required: false
- label: "`Fast Client`: This is a stateful client users use to query Venice Server for reading store data."
Expand Down
6 changes: 3 additions & 3 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
Add a list of affected components in the PR title in the following format:
[component1]...[componentN] Concise commit message

Valid component tags are: [da-vinci], [server], [controller],
[router], [samza], [vpj], [fast-client], [thin-client], [alpini],
[admin-tool], [test], [build], [doc], [script]
Valid component tags are: [da-vinci] (or [dvc]), [server], [controller], [router], [samza],
[vpj], [fast-client] (or [fc]), [thin-client] (or [tc]), [changelog] (or [cc]),
[pulsar-sink], [producer], [admin-tool], [test], [build], [doc], [script], [compat]

Example title: [server][da-vinci] Use dedicated thread to persist data to storage engine

Expand Down
73 changes: 0 additions & 73 deletions .github/rawWorkflows/gh-ci-alpini-parametrized-flow.txt

This file was deleted.

40 changes: 31 additions & 9 deletions .github/rawWorkflows/gh-ci-parameterized-flow.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,29 +2,26 @@
strategy:
fail-fast: false
matrix:
os: [ubuntu-latest]
jdk: [11]
runs-on: ${{ matrix.os }}
jdk: [17]
runs-on: ubuntu-latest
needs: $Dependency
if: $Conditional
timeout-minutes: $TimeOut
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Set up JDK
uses: actions/setup-java@v3
with:
java-version: ${{ matrix.jdk }}
distribution: 'microsoft'
distribution: 'temurin'
cache: 'gradle'
- shell: bash
run: |
git remote set-head origin --auto
git remote add upstream https://github.com/linkedin/venice
git fetch upstream
- name: Validate Gradle wrapper
uses: gradle/wrapper-validation-action@v1
- name: Build with Gradle
uses: gradle/gradle-build-action@v2
with:
Expand All @@ -36,11 +33,36 @@
mkdir ${{ github.job }}-artifacts
find . -path "**/build/reports/*" -or -path "**/build/test-results/*" > artifacts.list
rsync -R --files-from=artifacts.list . ${{ github.job }}-artifacts
tar -zcvf ${{ github.job }}-artifacts.tar.gz ${{ github.job }}-artifacts
tar -zcvf ${{ github.job }}-jdk${{ matrix.jdk }}-logs.tar.gz ${{ github.job }}-artifacts
- name: Upload Build Artifacts
if: success() || failure()
uses: actions/upload-artifact@v3
with:
name: ${{ github.job }}
path: ${{ github.job }}-artifacts.tar.gz
path: ${{ github.job }}-jdk${{ matrix.jdk }}-logs.tar.gz
retention-days: 30
- name: Search all test XML files
id: process_test_xml
run: |
FILES=$(find . -name "TEST-*.xml" | tr '\n' ',' | sed 's/,$//')
echo "files=$FILES" >> $GITHUB_OUTPUT
for file in $(echo $FILES | tr ',' ' '); do
# Process each file
echo "Processing $file"
done
- name: Upload test results to Codecov
if: ${{ !cancelled() }}
uses: codecov/test-results-action@v1
with:
files: ${{ steps.process_test_xml.outputs.files }}
token: ${{ secrets.CODECOV_TOKEN }}
- name: Upload test results to BuildPulse for flaky test detection
if: '!cancelled()' # Run this step even when the tests fail. Skip if the workflow is cancelled.
uses: buildpulse/buildpulse-action@main
with:
account: 7715725
repository: 540916718
path: |
**/TEST-*.xml
key: ${{ secrets.BUILDPULSE_ACCESS_KEY_ID }}
secret: ${{ secrets.BUILDPULSE_SECRET_ACCESS_KEY }}
Loading
Loading