Skip to content
This repository has been archived by the owner on Nov 25, 2023. It is now read-only.

Support all possible settings for pyarrow.fs.S3FileSystem #4

Open
jkausti opened this issue Mar 15, 2023 · 0 comments
Open

Support all possible settings for pyarrow.fs.S3FileSystem #4

jkausti opened this issue Mar 15, 2023 · 0 comments

Comments

@jkausti
Copy link
Owner

jkausti commented Mar 15, 2023

Currently, the target only supports 3 settings when interacting with S3. However, there are a whole lot more settings that can be set when interacting with pyarrow.fs.S3FileSystem. The target should ideally support all of them.

Best way would be to have some kind of generic 'S3 filesystem setting' which would be a dictionary where the user can specify whatever keys and values they want, the target would then just raise whatever error the S3FileSystem constructor raises when adding them as kwargs.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant