Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add metric and enhanced logging for query partial data #6676

Merged
merged 5 commits into from
Apr 3, 2025

Conversation

justinjung04
Copy link
Contributor

@justinjung04 justinjung04 commented Mar 27, 2025

What this PR does:

Query partial data (#6526) was introduced such that queries to ingesters return 200 even when data from ingesters can be partial.

This is an improvement on top to add metric and enhanced logging to further debug why partial data was returned to the customers.

Which issue(s) this PR fixes:
n/a

Checklist

  • Tests updated
  • Documentation added (n/a)
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Signed-off-by: Justin Jung <[email protected]>
@pull-request-size pull-request-size bot added size/L and removed size/M labels Mar 27, 2025
@justinjung04 justinjung04 changed the title Add metric and improved logging for partial data Add metric and enhanced logging for query partial data Mar 27, 2025
Signed-off-by: Justin Jung <[email protected]>
@justinjung04 justinjung04 marked this pull request as ready for review March 27, 2025 22:47
@dosubot dosubot bot added component/ring type/observability To help know what is going on inside Cortex labels Mar 27, 2025
Copy link
Contributor

@yeya24 yeya24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I think it makes sense. Since this is for partial data enabled case only I think makes sense to have more logging with it

@yeya24 yeya24 merged commit 33f363e into cortexproject:master Apr 3, 2025
17 checks passed
wilguo pushed a commit to wilguo/cortex that referenced this pull request Apr 10, 2025
…#6676)

* add metric

Signed-off-by: Justin Jung <[email protected]>

* improve log to include failed instance address

Signed-off-by: Justin Jung <[email protected]>

* more tests

Signed-off-by: Justin Jung <[email protected]>

* changelog

Signed-off-by: Justin Jung <[email protected]>

* include all partial errors in log

Signed-off-by: Justin Jung <[email protected]>

---------

Signed-off-by: Justin Jung <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/ring size/L type/observability To help know what is going on inside Cortex
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants