Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Apache Parquet - Geoparquet format #409

Open
4 of 7 tasks
eblondel opened this issue Feb 4, 2025 · 1 comment
Open
4 of 7 tasks

Support Apache Parquet - Geoparquet format #409

eblondel opened this issue Feb 4, 2025 · 1 comment
Labels
action:sf-write-generic entity enrichment new feature ongoing RnD
Milestone
1.0

Comments

@eblondel
Copy link
Collaborator

eblondel commented Feb 4, 2025 •
edited
Loading

Packages:

  • arrow
  • sfarrow
  • duckdb (for query over parquet either local/remote file)

TODO list

  • Support as sourceType
  • Support as uploadType (for conversion to parquet from a different sourceType)
  • Support in enrichWithData
  • Support in enrichWithData (with query mode ) => to test duckdb package
  • Support in enrichSpatialCoverageFromDB => to test duckdb package
  • Support for remote query (in case parquet file is online and we don't want to download the data, but just query it) => to think about the best way to do this. data accessor?
  • Support in sf-write-generic action

cc @juldebar @wheintz @bastienird
@eblondel eblondel added the RnD label Feb 4, 2025
@eblondel eblondel added this to the 1.0 milestone Feb 4, 2025
@eblondel
Copy link
Collaborator Author

eblondel commented Feb 4, 2025

First support here: c8e73ae

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
action:sf-write-generic entity enrichment new feature ongoing RnD
Projects
None yet
Milestone
1.0
Development

No branches or pull requests
1 participant
@eblondel