Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report: missing lineage for data source #735

Open
DaimonPl opened this issue Jun 17, 2020 · 2 comments
Open

Report: missing lineage for data source #735

DaimonPl opened this issue Jun 17, 2020 · 2 comments

Comments

@DaimonPl
Copy link
Contributor

Just an idea, in our current setup spline is not enabled everywhere (currently on purpose, initial phase).

It would be helpful if there was report in UI showing which datasources do not have their lineage - sorted by number of usages

So if i have 3 jobs which are using datasource "users" and i don't have lineage for "users" itself, report could show that this datasource with that URI is used by 3 jobs but lineage is not available

@wajda
Copy link
Contributor

wajda commented Jun 17, 2020

Good idea We'll think about it in a scope of a new UI
Meantime you can use the following AQL query to achieve that:

FOR ds IN dataSource
    LET lineage_cnt = LENGTH(FOR a IN affects FILTER a._to == ds._id RETURN ds)
    LET impacts_cnt = LENGTH(FOR d IN depends FILTER d._to == ds._id RETURN ds)
    FILTER lineage_cnt == 0
    RETURN [impacts_cnt, ds.uri]

@wajda
Copy link
Contributor

wajda commented Dec 10, 2020

related to #804

@wajda wajda changed the title UI - missing lineage report Report: missing lineage for data source Mar 27, 2021
@wajda wajda added this to Spline Mar 31, 2022
@wajda wajda moved this to New in Spline Mar 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: New
Development

No branches or pull requests

2 participants