Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Column-level granularity #385

Closed
gastlich opened this issue Oct 5, 2023 · 0 comments · Fixed by #386
Closed

Column-level granularity #385

gastlich opened this issue Oct 5, 2023 · 0 comments · Fixed by #386
Labels
enhancement New feature or request

Comments

@gastlich
Copy link
Contributor

gastlich commented Oct 5, 2023

Describe the feature

Hello guys, thank your for working on this amazing package. We are trying to use it as our only tool when it comes to DBT project validation. In order to achieve this, we need to run certain custom validation rules on the top of columns, not just nodes (models). To give you an example, we would like to forbid certain column names to be used across our project.

We hoped, that int_all_graph_resources is going to give as this answer by seeing column_name column in it, but it looks like it's set only for generic tests.

Then we thought, maybe we can find anything in the underlaying staging models like stg_nodes, but still no luck.

Describe alternatives you've considered

Lastly, we check the underlaying implementation:

node.columns.values() | list | length,
node.columns.values() | list | selectattr('description') | list | length,

And it's clear you gather only information related to columns count, not what they are.

Additionally, there was a request last year related to validating missing column descriptions, which was automatically closed:
#199

Who will this benefit?

Anyone who is willing to start using column-level rules.

Are you interested in contributing this feature?

I gave it a go: #386

@gastlich gastlich added the enhancement New feature or request label Oct 5, 2023
@gastlich gastlich mentioned this issue Oct 7, 2023
15 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant