Data isn't parsed from S3 Source if the file has more than one record
Example data:
an example of the file with which data is transferred
{"id": 44, "name": "Bob"}
an example of the file with which data isn't transferred
{"id": 44, "name": "Bob"}
{"id": 45, "name": "Alex"}
Logs: 2022-05-09T09:28:09+00:00 ERR node stopped error="node 61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stopped with error: error receiving ack: failed to get payload: failed to unmarshal data into structured data: invalid character '{' after top-level value" component=pipeline.Service node_id=61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/connector/destination.go","func":"github.com/conduitio/conduit/pkg/connector.(*destination.Ack","line":194},{"file":"/Users/serhii/conduit/pkg/plugin/standalone/v1/destination.go","func":"github.com/conduitio/conduit/pkg/plugin/standalone/v1.(*destinationPluginClient.Ack","line":120}]
Data isn't parsed from S3 Source if the file has more than one record
Example data:
an example of the file with which data is transferred
{"id": 44, "name": "Bob"}
an example of the file with which data isn't transferred
{"id": 44, "name": "Bob"}
{"id": 45, "name": "Alex"}
Logs: 2022-05-09T09:28:09+00:00 ERR node stopped error="node 61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stopped with error: error receiving ack: failed to get payload: failed to unmarshal data into structured data: invalid character '{' after top-level value" component=pipeline.Service node_id=61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/connector/destination.go","func":"github.com/conduitio/conduit/pkg/connector.(*destination.Ack","line":194},{"file":"/Users/serhii/conduit/pkg/plugin/standalone/v1/destination.go","func":"github.com/conduitio/conduit/pkg/plugin/standalone/v1.(*destinationPluginClient.Ack","line":120}]