Skip to content

Latest commit

 

History

History
22 lines (17 loc) · 804 Bytes

File metadata and controls

22 lines (17 loc) · 804 Bytes

FsspecNDSource

A :ref:`ProxyNDSource` that serves the chunks of a Blosc2 frame living behind an fsspec URL, reading each one with a range request instead of transferring the whole container. For other sources, see :ref:`ProxyNDSource` and :ref:`ProxySource`.

examples/ndarray/rw-fsspec.py is a runnable walkthrough of this and the other two ways to read an fsspec URL, and of writing one back. examples/ndarray/concurrent-fsspec.py measures max_concurrency against a filesystem with a simulated round trip, since no protocol that runs offline has latency for the thread pool to hide.

.. currentmodule:: blosc2

.. autoclass:: FsspecNDSource
    :members:
    :exclude-members: all, any, max, mean, min, prod, std, sum, var
    :member-order: groupwise