aws-jdk21环境 ArrowStreamRecordReade.read()报错

[dawnDy]

org.apache.arrow.memory.CheckAllocator] [CheckAllocator.java:99] [trace=,span=] - Using DefaultAllocationManager at memory-netty-18.2.0.jar!/org/apache/arrow/memory/netty/DefaultAllocationManagerFactory.class
java.lang.RuntimeException: Failed to initialize MemoryUtil. You must start Java with --add-opens=java.base/java.nio=org.apache.arrow.memory.core,ALL-UNNAMED (See https://arrow.apache.org/docs/java/install.html)
at org.apache.arrow.memory.util.MemoryUtil.(MemoryUtil.java:140)
at org.apache.arrow.memory.ArrowBuf.getDirectBuffer(ArrowBuf.java:212)
at org.apache.arrow.memory.ArrowBuf.nioBuffer(ArrowBuf.java:207)
at org.apache.arrow.vector.ipc.ReadChannel.readFully(ReadChannel.java:83)
at org.apache.arrow.vector.ipc.message.MessageSerializer.readMessageBody(MessageSerializer.java:748)
at org.apache.arrow.vector.ipc.message.MessageChannelReader.readNext(MessageChannelReader.java:62)
at org.apache.arrow.vector.ipc.ArrowStreamReader.loadNextBatch(ArrowStreamReader.java:144)
at com.aliyun.odps.data.ArrowReaderWrapper.read(ArrowReaderWrapper.java:24)
at com.aliyun.odps.data.ArrowStreamRecordReader.read(ArrowStreamRecordReader.java:170)

odps-sdk-core版本从0.50.5-public到0.54.0-public都有这个问题
需要手动在启动参数新加--add-opens=java.base/java.nio=org.apache.arrow.memory.core,ALL-UNNAMED 。这个兼容处理吗

[dingxin-tech]

是的，由于 SDK 使用 Apache Arrow 作为数据传输协议（之一）。
在 JDK 9+ 的版本，需要增加 --add-opens=java.base/java.nio=org.apache.arrow.memory.core,ALL-UNNAMED
当然，在环境变量里增加也可以