Skip to content

Commit be022d9

Browse files
etspacemansrowen
authored andcommitted
[SPARK-29677][DSTREAMS] amazon-kinesis-client 1.12.0
### What changes were proposed in this pull request? Upgrading the amazon-kinesis-client dependency to 1.12.0. ### Why are the changes needed? The current amazon-kinesis-client version is 1.8.10. This version depends on the use of `describeStream`, which has a hard limit on an AWS account (10 reqs / second). Versions 1.9.0 and up leverage `listShards`, which has no such limit. For large customers, this can be a major problem. ### Does this PR introduce any user-facing change? No ### How was this patch tested? Existing tests Closes apache#26333 from etspaceman/kclUpgrade. Authored-by: Eric Meisel <[email protected]> Signed-off-by: Sean Owen <[email protected]>
1 parent 31ae446 commit be022d9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -151,7 +151,7 @@
151151
<codahale.metrics.version>3.2.6</codahale.metrics.version>
152152
<avro.version>1.8.2</avro.version>
153153
<avro.mapred.classifier>hadoop2</avro.mapred.classifier>
154-
<aws.kinesis.client.version>1.8.10</aws.kinesis.client.version>
154+
<aws.kinesis.client.version>1.12.0</aws.kinesis.client.version>
155155
<!-- Should be consistent with Kinesis client dependency -->
156156
<aws.java.sdk.version>1.11.271</aws.java.sdk.version>
157157
<!-- the producer is used in tests -->

0 commit comments

Comments
 (0)