Skip to content

Allow setting ClientOptions for datafusion.object_store contexts #1082

Open
@nathschmidt

Description

@nathschmidt

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to the what)

Currently, there doesn't seem to be a way to set the ClientOptions used by the object store contexts from Python. This limits configurability and can lead to issues like connection/request timeouts and incorrectly configured CA hampering usage in some setups - especially corporate or multi-cloud setups.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Let's expose passing ClientOption in for all datafusion.object_store contexts (e.g. PyAmazonS3Context, PyGoogleCloudContext, etc).

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions