Some time back, I wrote an article on Configuring a Kafka Connect pipeline on Kubernetes and how to configure the connectors to move data from a MySQL database (using JDBCSourceConnector) to a text file (using FileSinkConnector).

In this article, I will take that setup a step forward, introduce a CDC tool, Debezium, and walk through the steps required to enable data transfer from MySQL to PostgreSQL using Debezium and KafkaConnect.

Why CDC?

The first question that crosses our minds is “Why do we need CDC?”. We already have a pipeline configured, then why bother introducing something new to the setup?

#helm #postgresql #mysql #kafka-connect