Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Fix unequal DataFrame column heights from parquet hive scan with filter #21340

Merged
merged 3 commits into from
Feb 20, 2025

Conversation

@github-actions github-actions bot added fix Bug fix python Related to Python Polars rust Related to Rust Polars labels Feb 19, 2025
@nameexhaustion nameexhaustion force-pushed the hive-filter-height-mismatch branch from afbf157 to 6b6fa5b Compare February 19, 2025 15:06
&mut df,
schema.as_ref(),
hive_partition_columns,
md.num_rows(),
Copy link
Collaborator Author

@nameexhaustion nameexhaustion Feb 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cause was due to materializing md.num_rows() height hive partition columns on a filtered DataFrame that may have less rows.

Fix this by removing the extra n_rows arg. It was needed in the past due to empty DataFrames not having the height property. Now that we have the height property we simply need to ensure it is set to the correct height for empty DataFrames.

@nameexhaustion nameexhaustion force-pushed the hive-filter-height-mismatch branch from 6b6fa5b to 81e76c6 Compare February 19, 2025 15:11
@nameexhaustion nameexhaustion changed the title fix: Hive filter fix: Unequal DataFrame column heights from parquet hive scan with filter Feb 19, 2025
Copy link

codecov bot commented Feb 19, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.93%. Comparing base (53f0bfd) to head (67fd23f).
Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #21340      +/-   ##
==========================================
- Coverage   79.93%   79.93%   -0.01%     
==========================================
  Files        1596     1596              
  Lines      228623   228599      -24     
  Branches     2618     2618              
==========================================
- Hits       182752   182732      -20     
+ Misses      45272    45268       -4     
  Partials      599      599              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@nameexhaustion nameexhaustion force-pushed the hive-filter-height-mismatch branch from 3d979c2 to c0a4d14 Compare February 19, 2025 16:42
@nameexhaustion nameexhaustion changed the title fix: Unequal DataFrame column heights from parquet hive scan with filter fix: Fix unequal DataFrame column heights from parquet hive scan with filter Feb 20, 2025
@nameexhaustion nameexhaustion force-pushed the hive-filter-height-mismatch branch from e5d9edc to 9d4adc4 Compare February 20, 2025 08:39
@nameexhaustion nameexhaustion force-pushed the hive-filter-height-mismatch branch from 9d4adc4 to 4f496f9 Compare February 20, 2025 08:40
# symlinking the binary.
ln -sv \
$(python -c "import importlib; print(importlib.util.find_spec('polars').submodule_search_locations[0] + '/polars.abi3.so')") \
py-polars/polars/polars.abi3.so
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I need this for the new test case I added below

This is CI logs for the failure - https://github.com/pola-rs/polars/actions/runs/13417351173/job/37481333425

@nameexhaustion nameexhaustion marked this pull request as ready for review February 20, 2025 09:22
@ritchie46 ritchie46 merged commit c0f345f into pola-rs:main Feb 20, 2025
27 checks passed
@Bidek56
Copy link
Contributor

Bidek56 commented Feb 20, 2025

Still panicking for me.

thread '<unnamed>' panicked at crates/polars-io/src/parquet/read/predicates.rs:17:68:
called `Option::unwrap()` on a `None` value
stack backtrace:
   0: rust_begin_unwind
             at /rustc/1891c28669863bf7ed3ef8f43f2d3fa546f34861/library/std/src/panicking.rs:692:5
   1: core::panicking::panic_fmt
             at /rustc/1891c28669863bf7ed3ef8f43f2d3fa546f34861/library/core/src/panicking.rs:75:14
   2: core::panicking::panic
             at /rustc/1891c28669863bf7ed3ef8f43f2d3fa546f34861/library/core/src/panicking.rs:145:5
   3: core::option::unwrap_failed
             at /rustc/1891c28669863bf7ed3ef8f43f2d3fa546f34861/library/core/src/option.rs:2015:5
   4: core::option::Option<T>::unwrap
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/option.rs:978:21
   5: polars_io::parquet::read::predicates::collect_statistics::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/predicates.rs:17:28
   6: core::iter::adapters::map::map_try_fold::{{closure}}
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/map.rs:95:28
   7: core::iter::adapters::map::map_try_fold::{{closure}}
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/map.rs:95:21
   8: core::iter::traits::iterator::Iterator::try_fold
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:2370:21
   9: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/map.rs:121:9
  10: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/map.rs:121:9
  11: <core::iter::adapters::GenericShunt<I,R> as core::iter::traits::iterator::Iterator>::try_fold
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/mod.rs:191:9
  12: core::iter::traits::iterator::Iterator::try_for_each
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:2431:9
  13: <core::iter::adapters::GenericShunt<I,R> as core::iter::traits::iterator::Iterator>::next
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/mod.rs:174:14
  14: alloc::vec::Vec<T,A>::extend_desugared
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/mod.rs:3535:35
  15: <alloc::vec::Vec<T,A> as alloc::vec::spec_extend::SpecExtend<T,I>>::spec_extend
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/spec_extend.rs:19:9
  16: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter_nested::SpecFromIterNested<T,I>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/spec_from_iter_nested.rs:42:9
  17: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter::SpecFromIter<T,I>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/spec_from_iter.rs:34:9
  18: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/mod.rs:3427:9
  19: core::iter::traits::iterator::Iterator::collect
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:1971:9
  20: <core::result::Result<V,E> as core::iter::traits::collect::FromIterator<core::result::Result<A,E>>>::from_iter::{{closure}}
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/result.rs:1985:51
  21: core::iter::adapters::try_process
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/mod.rs:160:17
  22: <core::result::Result<V,E> as core::iter::traits::collect::FromIterator<core::result::Result<A,E>>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/result.rs:1985:9
  23: core::iter::traits::iterator::Iterator::collect
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:1971:9
  24: polars_io::parquet::read::predicates::collect_statistics
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/predicates.rs:14:17
  25: polars_io::parquet::read::predicates::read_this_row_group
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/predicates.rs:73:34
  26: polars_io::parquet::read::async_impl::FetchRowGroupsFromObjectStore::new::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/async_impl.rs:253:34
  27: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &mut F>::call_mut
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/ops/function.rs:294:13
  28: core::iter::traits::iterator::Iterator::find_map::check::{{closure}}
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:2859:32
  29: core::iter::traits::iterator::Iterator::try_fold
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:2370:21
  30: core::iter::traits::iterator::Iterator::find_map
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:2865:9
  31: <core::iter::adapters::filter_map::FilterMap<I,F> as core::iter::traits::iterator::Iterator>::next
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/adapters/filter_map.rs:64:9
  32: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter_nested::SpecFromIterNested<T,I>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/spec_from_iter_nested.rs:25:32
  33: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter::SpecFromIter<T,I>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/spec_from_iter.rs:34:9
  34: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/alloc/src/vec/mod.rs:3427:9
  35: core::iter::traits::iterator::Iterator::collect
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/iter/traits/iterator.rs:1971:9
  36: polars_io::parquet::read::async_impl::FetchRowGroupsFromObjectStore::new
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/async_impl.rs:248:13
  37: polars_io::parquet::read::reader::ParquetAsyncReader::batched::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/reader.rs:477:33
  38: polars_io::parquet::read::reader::ParquetAsyncReader::finish::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-io/src/parquet/read/reader.rs:520:47
  39: polars_mem_engine::executors::scan::parquet::ParquetExec::read_async::{{closure}}::{{closure}}::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-mem-engine/src/executors/scan/parquet.rs:484:30
  40: <F as futures_core::future::TryFuture>::try_poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-core-0.3.31/src/future.rs:92:9
  41: <futures_util::future::try_future::into_future::IntoFuture<Fut> as core::future::future::Future>::poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-util-0.3.31/src/future/try_future/into_future.rs:34:9
  42: <F as futures_core::future::TryFuture>::try_poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-core-0.3.31/src/future.rs:92:9
  43: <futures_util::future::try_maybe_done::TryMaybeDone<Fut> as core::future::future::Future>::poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-util-0.3.31/src/future/try_maybe_done.rs:79:49
  44: <F as futures_core::future::TryFuture>::try_poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-core-0.3.31/src/future.rs:92:9
  45: <futures_util::future::try_join_all::TryJoinAll<F> as core::future::future::Future>::poll
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/futures-util-0.3.31/src/future/try_join_all.rs:163:27
  46: polars_mem_engine::executors::scan::parquet::ParquetExec::read_async::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-mem-engine/src/executors/scan/parquet.rs:490:59
  47: tokio::runtime::park::CachedParkThread::block_on::{{closure}}
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/park.rs:281:63
  48: tokio::runtime::coop::with_budget
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/coop.rs:107:5
  49: tokio::runtime::coop::budget
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/coop.rs:73:5
  50: tokio::runtime::park::CachedParkThread::block_on
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/park.rs:281:31
  51: tokio::runtime::context::blocking::BlockingRegionGuard::block_on
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/context/blocking.rs:66:9
  52: tokio::runtime::scheduler::multi_thread::MultiThread::block_on::{{closure}}
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/scheduler/multi_thread/mod.rs:87:13
  53: tokio::runtime::context::runtime::enter_runtime
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/context/runtime.rs:65:16
  54: tokio::runtime::scheduler::multi_thread::MultiThread::block_on
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/scheduler/multi_thread/mod.rs:86:9
  55: tokio::runtime::runtime::Runtime::block_on_inner
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/runtime.rs:370:45
  56: tokio::runtime::runtime::Runtime::block_on
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/runtime.rs:342:13
  57: polars_io::pl_async::RuntimeManager::block_on_potential_spawn::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-io/src/pl_async.rs:310:40
  58: tokio::runtime::scheduler::multi_thread::worker::block_in_place
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/scheduler/multi_thread/worker.rs:457:9
  59: tokio::runtime::scheduler::block_in_place::block_in_place
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/runtime/scheduler/block_in_place.rs:20:5
  60: tokio::task::blocking::block_in_place
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.42.0/src/task/blocking.rs:78:9
  61: polars_io::pl_async::RuntimeManager::block_on_potential_spawn
             at /Users/usr/git/polars-main/crates/polars-io/src/pl_async.rs:310:9
  62: polars_mem_engine::executors::scan::parquet::ParquetExec::read_impl
             at /Users/usr/git/polars-main/crates/polars-mem-engine/src/executors/scan/parquet.rs:518:17
  63: <polars_mem_engine::executors::scan::parquet::ParquetExec as polars_mem_engine::executors::executor::Executor>::execute::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-mem-engine/src/executors/scan/parquet.rs:631:25
  64: polars_expr::state::execution_state::ExecutionState::record
             at /Users/usr/git/polars-main/crates/polars-expr/src/state/execution_state.rs:163:21
  65: <polars_mem_engine::executors::scan::parquet::ParquetExec as polars_mem_engine::executors::executor::Executor>::execute
             at /Users/usr/git/polars-main/crates/polars-mem-engine/src/executors/scan/parquet.rs:631:9
  66: polars_lazy::frame::LazyFrame::collect
             at /Users/usr/git/polars-main/crates/polars-lazy/src/frame/mod.rs:744:13
  67: polars_python::lazyframe::general::<impl polars_python::lazyframe::PyLazyFrame>::collect::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-python/src/lazyframe/general.rs:653:17
  68: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/core/src/panic/unwind_safe.rs:272:9
  69: std::panicking::try::do_call
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panicking.rs:584:40
  70: ___rust_try
  71: std::panicking::try
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panicking.rs:547:19
  72: std::panic::catch_unwind
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panic.rs:358:14
  73: polars_error::signals::catch_keyboard_interrupt
             at /Users/usr/git/polars-main/crates/polars-error/src/signals.rs:83:15
  74: <pyo3::marker::Python as polars_python::utils::EnterPolarsExt>::enter_polars::{{closure}}
             at /Users/usr/git/polars-main/crates/polars-python/src/utils.rs:104:41
  75: pyo3::marker::Python::allow_threads
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/pyo3-0.23.4/src/marker.rs:521:9
  76: <pyo3::marker::Python as polars_python::utils::EnterPolarsExt>::enter_polars
             at /Users/usr/git/polars-main/crates/polars-python/src/utils.rs:104:19
  77: polars_python::utils::EnterPolarsExt::enter_polars_df
             at /Users/usr/git/polars-main/crates/polars-python/src/utils.rs:81:9
  78: polars_python::lazyframe::general::<impl polars_python::lazyframe::PyLazyFrame>::collect
             at /Users/usr/git/polars-main/crates/polars-python/src/lazyframe/general.rs:623:9
  79: polars_python::lazyframe::general::<impl polars_python::lazyframe::PyLazyFrame>::__pymethod_collect__
             at /Users/usr/git/polars-main/crates/polars-python/src/lazyframe/general.rs:38:1
  80: pyo3::impl_::trampoline::cfunction_with_keywords::{{closure}}
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/pyo3-0.23.4/src/impl_/trampoline.rs:44:29
  81: pyo3::impl_::trampoline::trampoline::{{closure}}
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/pyo3-0.23.4/src/impl_/trampoline.rs:188:54
  82: std::panicking::try::do_call
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panicking.rs:584:40
  83: ___rust_try
  84: std::panicking::try
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panicking.rs:547:19
  85: std::panic::catch_unwind
             at /Users/usr/.rustup/toolchains/nightly-2025-01-05-aarch64-apple-darwin/lib/rustlib/src/rust/library/std/src/panic.rs:358:14
  86: pyo3::impl_::trampoline::trampoline
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/pyo3-0.23.4/src/impl_/trampoline.rs:188:9
  87: pyo3::impl_::trampoline::cfunction_with_keywords
             at /Users/usr/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/pyo3-0.23.4/src/impl_/trampoline.rs:44:13
  88: polars_python::lazyframe::general::_::__INVENTORY::trampoline
             at /Users/usr/git/polars-main/crates/polars-python/src/lazyframe/general.rs:38:1
  89: _method_vectorcall_VARARGS_KEYWORDS
  90: __PyEval_EvalFrameDefault
  91: _PyEval_EvalCode
  92: _run_eval_code_obj
  93: _run_mod
  94: _pyrun_file
  95: __PyRun_SimpleFileObject
  96: __PyRun_AnyFileObject
  97: _pymain_run_file_obj
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Traceback (most recent call last):
  File "/Users/usr/azure/delta/./readEventDeltaPolars.py", line 38, in <module>
    .collect()
     ^^^^^^^^^
  File "/Users/usr/git/polars-main/py-polars/polars/lazyframe/frame.py", line 2066, in collect
    return wrap_df(ldf.collect(callback))
                   ^^^^^^^^^^^^^^^^^^^^^
pyo3_runtime.PanicException: called `Option::unwrap()` on a `None` value

@nameexhaustion
Copy link
Collaborator Author

@Bidek56 , can you open a separate issue with a reproducible example

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fix Bug fix python Related to Python Polars rust Related to Rust Polars
Projects
None yet
3 participants