Skip to content

Conversation

@zach-overflow
Copy link
Contributor

@zach-overflow zach-overflow commented Dec 9, 2025


Closes: #33818

What?

  • Adds optional support for "trigger queues", which allows a given triggerer to consume from a user-configured subset of triggers.
    • Adds a trigger_queues instance attribute to the Triggerer, which comes from the triggerer.consume_trigger_queues config option, or the --consume-trigger-queues CLI option.
    • Adds a trigger_queue instance attribute to the Trigger, which may either be explicitly set on initialization, or will use the new triggerer.default_trigger_queue config as a default.

Why?

  • AIP-67 (multi-tenancy support), to enable team-specific triggerer assignment.
  • More generally, and not necessarily specific to multi-tenancy use-cases, to allow for other trigger strategies which may require distinct sets of triggerers.

Remaining TODOs before removing "Draft" status

  • Figure out why alembic is not detecting a change to the trigger table / not auto-generating a new revision.
  • Run db tests once an alembic revision can be generated.
  • Add newsfragment file summarizing this change.

Testing

  • breeze testing core-tests airflow-core/tests/unit --skip-db-tests --use-xdist
  • breeze testing providers-tests --run-in-parallel --skip-db-tests
  • prek

encrypted_kwargs: Mapped[str] = mapped_column("kwargs", Text, nullable=False)
created_date: Mapped[datetime.datetime] = mapped_column(UtcDateTime, nullable=False)
triggerer_id: Mapped[int | None] = mapped_column(Integer, nullable=True)
trigger_queue: Mapped[str] = mapped_column(String(128), nullable=True)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would expect alembic to have detected this change, but whenever I follow this contributor doc section, I get the following issue:

Screenshot 2025-12-09 at 9 36 01 AM

This happens despite running breeze --backend postgres --db-reset rebased off main latest, so any thoughts on what I might be missing are appreciated!

@zach-overflow zach-overflow force-pushed the zg/support-triggerer-queues branch from 9102400 to 7934a36 Compare December 9, 2025 14:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support dispatching triggers to different triggerer instances.

1 participant