You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have issues reading an encrypted data stream in AWS. I have no errors in my logs but my spark job is not fetching any records from the stream.
I am using this version of the library: spark-sql-kinesis_2.12-1.2.0_spark-3.0.jar
My stream is configured to use Server-side encryption.
Based on the documenation: "Kinesis Data Streams uses AWS Key Management Service (KMS) to encrypt your data."
When I deactivate this feature, my spark job is able to pull records from the stream without any problems.
Do I need to configure something or it should be transparent?
We have Lambda that reads from that same stream without problems.
The text was updated successfully, but these errors were encountered:
I have issues reading an encrypted data stream in AWS. I have no errors in my logs but my spark job is not fetching any records from the stream.
I am using this version of the library: spark-sql-kinesis_2.12-1.2.0_spark-3.0.jar
My stream is configured to use Server-side encryption.
Based on the documenation: "Kinesis Data Streams uses AWS Key Management Service (KMS) to encrypt your data."
When I deactivate this feature, my spark job is able to pull records from the stream without any problems.
Do I need to configure something or it should be transparent?
We have Lambda that reads from that same stream without problems.
The text was updated successfully, but these errors were encountered: