reducing I/O by using buffers and memoryviews

[armijnhemel]

This is something that I haven't fully thought out yet, but which might be useful in certain cases, such as when io is shared between elements (so when no new substreams are created). There are mechanisms in Python to reduce I/O and prevent unnecessary copying of data by using buffers and memoryviews. An article explaining it can be found here:

https://eli.thegreenplace.net/2011/11/28/less-copies-in-python-with-the-buffer-protocol-and-memoryviews

[KOLANICH]

kaitai-io/kaitai_struct#277
kaitai-io/kaitai_struct#65

are related. Mmaps are memory views.

[armijnhemel]

kaitai-io/kaitai_struct#277 kaitai-io/kaitai_struct#65

are related. Mmaps are memory views.

Not according to the documentation:

"Create a memoryview that references object. object must support the buffer protocol. Built-in objects that support the buffer protocol include bytes and bytearray."

https://docs.python.org/3/library/stdtypes.html#memoryview

As far as I can tell mmap does not support the buffer protocol.

[KOLANICH]

@armijnhemel, my bad, you are right. To work with mmaps as with memory views we really have to wrap it into it. Thanks for fixing me.

[KOLANICH]

https://github.com/althonos/iocursor BTW.