Skip to content

feat(ingestion/teradata): observability reporting gaps#17655

Open
NehaGslab wants to merge 30 commits into
datahub-project:masterfrom
NehaGslab:feat-teradata-observability-reporting-gaps
Open

feat(ingestion/teradata): observability reporting gaps#17655
NehaGslab wants to merge 30 commits into
datahub-project:masterfrom
NehaGslab:feat-teradata-observability-reporting-gaps

Conversation

@NehaGslab
Copy link
Copy Markdown
Contributor

@NehaGslab NehaGslab commented Jun 1, 2026

  • Added regex patterns and keywords to categorize SQL syntax/parse errors and permission/access-denied failures.
  • Implemented a new function _categorize_view_error to classify exceptions and return appropriate error categories.
  • Updated TeradataReport to include counters for schema discovery failures, view timeouts, parse errors, permission errors, and unknown errors.
  • Enhanced error handling in view processing to increment the corresponding counters based on the categorized error type.
  • Added unit tests for _categorize_view_error and validation of error counters in TeradataReport to ensure correct functionality.
  • Added lineage query timing and slow query detection for improved performance monitoring
  • Enhanced view error handling and reporting by introducing increment_view_error method
  • Updated log for lineage_slow_query_log_seconds

@github-actions github-actions Bot added ingestion PR or Issue related to the ingestion of metadata community-contribution PR or Issue raised by member(s) of DataHub Community labels Jun 1, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented Jun 1, 2026

Bundle Report

Changes will increase total bundle size by 97.17kB (0.42%) ⬆️. This is within the configured threshold ✅

Detailed changes
Bundle name Size Change
datahub-react-web-esm 23.5MB 97.17kB (0.42%) ⬆️

Affected Assets, Files, and Routes:

view changes for bundle: datahub-react-web-esm

Assets Changed:

Asset Name Size Change Total Size Change (%)
assets/index-*.js 22.02kB 8.85MB 0.25%
assets/en-*.js 75.14kB 201.61kB 59.42% ⚠️

@codecov
Copy link
Copy Markdown

codecov Bot commented Jun 1, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@NehaGslab NehaGslab changed the title Feat teradata observability reporting gaps feat(ingestion/teradata): observability reporting gaps Jun 1, 2026
@NehaGslab NehaGslab marked this pull request as ready for review June 1, 2026 14:06
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 1, 2026

Linear: ING-2791

Thanks for your contribution! We have created an internal ticket to track this PR. A member of the core DataHub team will be assigned to review it within the next few business days - you will get a follow-up comment once a reviewer is assigned.

…ery handling and enhance error reporting in view processing
…ing logic into a dedicated method for clearer categorization and reporting
…ure timing records are captured on execution failures
NehaGslab added 2 commits June 1, 2026 21:49
…rror handling contract and prevent double-counting of errors
@maggiehays maggiehays added the needs-review Label for PRs that need review from a maintainer. label Jun 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution PR or Issue raised by member(s) of DataHub Community ingestion PR or Issue related to the ingestion of metadata needs-review Label for PRs that need review from a maintainer.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants