Skip to content

Dask distribued warnings  #49

Description

@norlandrhagen

Love the library @ahuang11!

I'm getting a whole bunch of dask distribued related warnings. It doesn't seem to stop the annimation creation, but I thought I would log them here.

WARNING - Detected different run_specfor key 'original-open_dataset-air_temperature-4df8cbd6792390e2a6aab50a444ada81' between two consecutive calls toupdate_graph.

Details

2024-09-19 20:46:58,147 - distributed.scheduler - WARNING - Detected different run_spec for key 'original-open_dataset-air_temperature-4df8cbd6792390e2a6aab50a444ada81' between two consecutive calls to update_graph. This can cause failures and deadlocks down the line. Please ensure unique key names. If you are using a standard dask collections, consider releasing all the data before resubmitting another computation. More details and help can be found at dask/dask#9888.
Debugging information

old task state: memory
old run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b3435ffc0>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
new run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b2c1fc700>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
old token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['25b9b4dc432aacc4'])]), ('dict', [])])
new token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['16a6f7afe21af26a'])]), ('dict', [])])
old dependencies: set()
new dependencies: set()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions