Skip to content

Can't import awswrangler when installed with ray extras #3248

@noamgot

Description

@noamgot

Describe the bug

After installing awswrangler with ray (& modin) extras, I got this error:

# ...
    from ray.data.datasource.parquet_meta_provider import (
ModuleNotFoundError: No module named 'ray.data.datasource.parquet_meta_provider'

I assume it's due to some breaking change on ray's side (from a quick test - looks like it's broken since v2.50 and onwards)
please review this
thanks!

How to Reproduce

> uv init awswrangler-bug
> cd awswrangler-bug
> uv add "awswrangler[moding,ray]"
> uv run python -c "import awswrangler" 
# ...
    from ray.data.datasource.parquet_meta_provider import (
ModuleNotFoundError: No module named 'ray.data.datasource.parquet_meta_provider'

Expected behavior

the import should work...

Your project

No response

Screenshots

No response

OS

Linux

Python version

3.12

AWS SDK for pandas version

3.14.0

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions