Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run ETL process for GitHub data in staging environments #2857

Closed
3 tasks done
DavidDudas-Intuitial opened this issue Nov 14, 2024 · 1 comment
Closed
3 tasks done
Assignees

Comments

@DavidDudas-Intuitial
Copy link
Collaborator

DavidDudas-Intuitial commented Nov 14, 2024

Summary

Follow up to #2665 in which the db was initialized manually by running SQL statements in RDS query editor, which is not desirable for staging and prod environments. Instead, we would like our programmatic database migrations and our ETL to be able to run to completion in staging. This requires various privileges, permissions, configurations, etc.

Acceptance criteria

  • Database migrations can execute automatically in staging environment
  • ETL process for GitHub data runs successfully in staging environments
  • GitHub data is available in the staging Metabase instance
@DavidDudas-Intuitial DavidDudas-Intuitial self-assigned this Nov 14, 2024
@widal001 widal001 moved this from In Progress to Blocked in Simpler Grants Product & Delivery Nov 26, 2024
@widal001 widal001 changed the title Automate analytics DB creation in staging and prod environments Promote ETL process to staging and prod environments Nov 26, 2024
@widal001 widal001 changed the title Promote ETL process to staging and prod environments Run ETL process for GitHub data in staging and prod environments Nov 26, 2024
@widal001 widal001 moved this from Blocked to In Progress in Simpler Grants Product & Delivery Dec 9, 2024
@widal001 widal001 changed the title Run ETL process for GitHub data in staging and prod environments Run ETL process for GitHub data in staging environments Dec 9, 2024
@widal001
Copy link
Collaborator

widal001 commented Dec 9, 2024

Here's screenshots of the data showing up in the staging Metabase instance

Image
Image

@widal001 widal001 closed this as completed Dec 9, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in Simpler Grants Product & Delivery Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

No branches or pull requests

2 participants