Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement CDC - Capture Data Change #752

Open
eolivelli opened this issue Jul 10, 2021 · 1 comment
Open

Implement CDC - Capture Data Change #752

eolivelli opened this issue Jul 10, 2021 · 1 comment

Comments

@eolivelli
Copy link
Contributor

FEATURE REQUEST

  1. Please describe the feature you are requesting.

All databases have a way to send a log of mutation to third party tools (like Debezium).

Implementing CDC in HerdDB is trivial as we can just provide a way to 'tail' the logs and send the changes somewhere instead of building a local copy of the database.

Basically we can create a new type of follower node that reads the log and forward the changes to some configurable component (Sink)

  1. Indicate the importance of this issue to you
    Nice to have

  2. Provide any additional detail on your proposed use case for this feature.

The first sink of this CDC flow may be an Apache Pulsar topic.
Pulsar IO users will be able to consume the stream of Mutations and process them.

@eolivelli
Copy link
Contributor Author

part one is #753

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants