Skip to content

[datadog_observability_pipeline] Add new metrics processors: add_metric_tags, aggregate, rename_metric_tags, tag_cardinality_limit#3818

Open
ArunPiduguDD wants to merge 6 commits into
masterfrom
arun.pidugu/op-metrics-processors
Open

[datadog_observability_pipeline] Add new metrics processors: add_metric_tags, aggregate, rename_metric_tags, tag_cardinality_limit#3818
ArunPiduguDD wants to merge 6 commits into
masterfrom
arun.pidugu/op-metrics-processors

Conversation

@ArunPiduguDD
Copy link
Copy Markdown

@ArunPiduguDD ArunPiduguDD commented May 22, 2026

Summary

  • Adds Terraform support for four new metrics-only Observability Pipelines processors: `add_metric_tags`, `aggregate`, `rename_metric_tags`, `tag_cardinality_limit`.
  • Each processor lives in its own file under `datadog/fwprovider/observability_pipeline/` (schema + expand + flatten) and is wired into `resource_datadog_observability_pipeline.go`.
  • Regenerated `docs/resources/observability_pipeline.md` via `make docs`.

API spec companion PR: DataDog/datadog-api-spec#5700.

Test plan

  • `go build ./...` is clean
  • All four new acceptance tests pass live against staging (`api.datad0g.com`):
    • `TestAccDatadogObservabilityPipeline_addMetricTagsProcessor`
    • `TestAccDatadogObservabilityPipeline_aggregateProcessor`
    • `TestAccDatadogObservabilityPipeline_renameMetricTagsProcessor`
    • `TestAccDatadogObservabilityPipeline_tagCardinalityLimitProcessor`
  • Cassettes recorded with `RECORD=true` and committed

Notes

  • The `tag_cardinality_limit` test currently exercises only the `tracked` / `limit_override` code paths. The companion validator change that makes `limit_exceeded_action` / `value_limit` / `per_tag_limits` forbidden when `mode = "excluded"` hasn't deployed yet; once it does, a follow-up will add an excluded-mode case.

🤖 Generated with Claude Code

@ArunPiduguDD ArunPiduguDD requested review from a team as code owners May 22, 2026 14:05
@ArunPiduguDD ArunPiduguDD changed the title Add OP metrics processors: add_metric_tags, aggregate, rename_metric_tags, tag_cardinality_limit [Terraform] Add new OP metrics processors May 22, 2026
@ArunPiduguDD ArunPiduguDD force-pushed the arun.pidugu/op-metrics-processors branch from 8ae6021 to 6b3eced Compare May 22, 2026 15:28
@datadog-datadog-prod-us1-2

This comment has been minimized.

Sign in to view
@ArunPiduguDD ArunPiduguDD changed the title [Terraform] Add new OP metrics processors Add new OP metrics processors May 26, 2026
@ArunPiduguDD ArunPiduguDD changed the title Add new OP metrics processors Add new OP metrics processors to terraform provider May 26, 2026
@ArunPiduguDD ArunPiduguDD force-pushed the arun.pidugu/op-metrics-processors branch from 6b3eced to ef739cd Compare May 26, 2026 19:16
@ArunPiduguDD ArunPiduguDD requested a review from a team as a code owner May 26, 2026 19:24
@ArunPiduguDD ArunPiduguDD changed the title Add new OP metrics processors to terraform provider [datadog_observability_pipeline] Add new metrics processors: add_metric_tags, aggregate, rename_metric_tags, tag_cardinality_limit May 26, 2026
@gh-worker-ownership-write-b05516 gh-worker-ownership-write-b05516 Bot removed the request for review from a team May 26, 2026 19:48
ArunPiduguDD and others added 4 commits May 27, 2026 17:52
@ArunPiduguDD @claude
Add 4 new OP metrics processors: add_metric_tags, aggregate, rename_m…
8920219 
…etric_tags, tag_cardinality_limit

- New per-processor files under datadog/fwprovider/observability_pipeline/
- Wire schema + expand + flatten into resource_datadog_observability_pipeline.go
- Regenerated docs

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@ArunPiduguDD @claude
Add acceptance tests for 4 new OP metrics processors
88eea38 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@ArunPiduguDD @claude
Record cassettes for 4 new OP metrics processor tests
53e236d 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@ArunPiduguDD @claude
Fix goimports formatting in tag_cardinality_limit_processor.go
829c869 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@ArunPiduguDD ArunPiduguDD force-pushed the arun.pidugu/op-metrics-processors branch from 6614afe to 8aa71be Compare May 27, 2026 17:52
@ArunPiduguDD ArunPiduguDD force-pushed the arun.pidugu/op-metrics-processors branch from 8aa71be to 17cadb1 Compare May 27, 2026 18:00
@ArunPiduguDD ArunPiduguDD reopened this May 27, 2026
ArunPiduguDD and others added 2 commits May 27, 2026 18:18
@ArunPiduguDD @claude
Fix Go struct field alignment (make fmt)
b8ee09c 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@ArunPiduguDD @claude
Fix cassette host: replace staging with prod API endpoint
6718c07 
Cassettes were recorded against api.datad0g.com (staging); CI expects
api.datadoghq.com (prod).

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dd-sebastien-lb dd-sebastien-lb dd-sebastien-lb approved these changes

Assignees

No one assigned

Labels

changelog/feature

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@ArunPiduguDD @dd-sebastien-lb