I'm getting a whole bunch of dask distribued related warnings. It doesn't seem to stop the annimation creation, but I thought I would log them here.
Details
2024-09-19 20:46:58,147 - distributed.scheduler - WARNING - Detected different run_spec for key 'original-open_dataset-air_temperature-4df8cbd6792390e2a6aab50a444ada81' between two consecutive calls to update_graph. This can cause failures and deadlocks down the line. Please ensure unique key names. If you are using a standard dask collections, consider releasing all the data before resubmitting another computation. More details and help can be found at dask/dask#9888.
Debugging information
old task state: memory
old run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b3435ffc0>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
new run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b2c1fc700>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
old token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['25b9b4dc432aacc4'])]), ('dict', [])])
new token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['16a6f7afe21af26a'])]), ('dict', [])])
old dependencies: set()
new dependencies: set()
Love the library @ahuang11!
I'm getting a whole bunch of dask distribued related warnings. It doesn't seem to stop the annimation creation, but I thought I would log them here.
WARNING - Detected differentrun_specfor key 'original-open_dataset-air_temperature-4df8cbd6792390e2a6aab50a444ada81' between two consecutive calls toupdate_graph.Details
2024-09-19 20:46:58,147 - distributed.scheduler - WARNING - Detected different
run_specfor key 'original-open_dataset-air_temperature-4df8cbd6792390e2a6aab50a444ada81' between two consecutive calls toupdate_graph. This can cause failures and deadlocks down the line. Please ensure unique key names. If you are using a standard dask collections, consider releasing all the data before resubmitting another computation. More details and help can be found at dask/dask#9888.Debugging information
old task state: memory
old run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b3435ffc0>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
new run_spec: (<function execute_task at 0x793d1289a340>, (ImplicitToExplicitIndexingAdapter(array=CopyOnWriteArray(array=MemoryCachedArray(array=CopyOnWriteArray(array=LazilyIndexedArray(array=_ElementwiseFunctionArray(_ElementwiseFunctionArray(LazilyIndexedArray(array=<xarray.backends.zarr.ZarrArrayWrapper object at 0x793b2c1fc700>, key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))), func=functools.partial(<function _apply_mask at 0x793d1659e980>, encoded_fill_values={32767}, decoded_fill_value=nan, dtype=<class 'numpy.float64'>), dtype=dtype('float64')), func=functools.partial(<function _scale_offset_decoding at 0x793d1659eb60>, scale_factor=0.1, add_offset=220.0, dtype=dtype('float64')), dtype=dtype('float64')), key=BasicIndexer((slice(None, None, None), slice(None, None, None), slice(None, None, None)))))))),), {})
old token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['25b9b4dc432aacc4'])]), ('dict', [])])
new token: ('tuple', [('80935a1067ef908b', []), ('tuple', [('17bd4a2c61810541', ['16a6f7afe21af26a'])]), ('dict', [])])
old dependencies: set()
new dependencies: set()