Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Identify additional tool development needed for shipping .duckdb to users #3

Open
3 tasks
theamarks opened this issue Feb 11, 2025 · 0 comments
Open
3 tasks
Assignees
Labels
🪄 enhancement New functionality or feature request

Comments

@theamarks
Copy link
Member

theamarks commented Feb 11, 2025

Description

We need to test the new duckdb data base format and metadata schema.

  • Do we currently have the tools required for users to query data and metadata smoothly?
  • Existing R or python packages? exploreARTIS:: package? duckplyr:: package? etc.

Ideally in the future we would develop new functions in existing R package to help users interact with .duckdb
Seafood-Globalization-Lab/exploreARTIS Github repo

To-Do

  • Upload .duckdb protype to Google Drive to share with Jessica and Althea
  • Write example .R script to simulate a basic ARTIS analysis using the .duckdb prototype (how would a user query or extract data from .duckdb
# example script could include: 

# connect to .duckdb
# query tables using R package duckplyr

# Get SAU Production dataframe
prod_sau <- dbGetQuery(con, "SELECT * FROM sau_production") %>%
  select(-record_id) 

# Get Species metadata into local environment object
sciname_metadata <- dbGetQuery(con, "SELECT * FROM sciname") %>%
  select(-record_id)

  • Write R function to extract/query EML metadata
@theamarks theamarks added the 🪄 enhancement New functionality or feature request label Feb 11, 2025
@theamarks theamarks added this to the Ship ARTIS in duckdb milestone Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🪄 enhancement New functionality or feature request
Projects
Status: No status
Development

No branches or pull requests

2 participants