Skip to content

Exposing FFI to python #1137

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

renato2099
Copy link

Which issue does this PR close?

Closes #1091

Rationale for this change

Similar to exposing FFI for TableProviders, this PR exposes the capability for exposing CatalogProvider in python, now that apache/datafusion#15280 was merged.

What changes are included in this PR?

Includes the necessary changes to expose the FFICatalogProvider, an example, and the corresponding use case.

Are there any user-facing changes?

Yes, the new register_catalog method in the SessionContext
No breaking changes.

@renato2099 renato2099 force-pushed the renato2099/1091_ffi_cataglog branch from d896ab8 to 7b09073 Compare June 1, 2025 21:23
@renato2099
Copy link
Author

Hi @timsaucer , if you could please take a pass on this PR , that would be great, thanks!

@timsaucer
Copy link
Contributor

This is great. We had someone open a related issue #1103 and it would be fantastic if we could address both of them at once. Do you think you could enhance this PR to handle python based catalogs and schemas as well? It is something I was planning to work on but I've been hard at work trying to get metadata handling in the upstream repo. I still have a bit of work there before I can focus on this repo again. Which is to say, I can take what you have here (which is great) and work from it if you need.

Does that all make sense?

@renato2099
Copy link
Author

Do you think you could enhance this PR to handle python based catalogs and schemas as well?

yes, I can try to do so, I will go and read what this is about and come back :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add CatalogProvider and SchemaProvider
2 participants