Calrissian has OOM after _cwl_insar

[EmileSonneveld]

Running this OpenEO job errors just at the end of the CWL

import openeo
import openeo.processes
import openeo.internal

url = "https://openeo-staging.dataspace.copernicus.eu/"
connection = openeo.connect(url).authenticate_oidc()

datacube = openeo.rest.datacube.DataCube(
    openeo.rest.datacube.PGNode(
        "_cwl_insar",
        arguments={
            "spatial_extent": {
                "west": 10.751,
                "south": 46.741,
                "east": 10.759,
                "north": 46.749
            },
            "temporal_extent": [
                "2024-08-14",
                "2024-08-26"
            ]
        },
    ),
    connection=connection,
)

datacube.download("cwl_result.json")

When running locally, it shows that a lot of memory gets used:

Error on https://openeo-staging.dataspace.copernicus.eu/

  File "/opt/openeo/lib/python3.8/site-packages/openeogeotrellis/integrations/calrissian.py", line 37, in read
    s3_file_object = s3_client().get_object(Bucket=self.s3_bucket, Key=self.s3_key)
  File "/opt/openeo/lib/python3.8/site-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/opt/openeo/lib/python3.8/site-packages/botocore/client.py", line 676, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.errorfactory.NoSuchKey: An error occurred (NoSuchKey) when calling the GetObject operation: None