.svg)
MySQL CDC Overview
MySQL delivers a very fast, multithreaded, multi-user, and robust SQL (Structured Query Language) database server. It is intended for mission-critical, heavy-load production systems as well as for embedding into mass-deployed software. MySQL is one of the most popular database management systems in the world, successfully powering many applications. MySQL is typically used for managing the core (or transactional) data of applications, such as products or sales in an e-commerce shop, and is often complemented with other data systems, e.g., a data warehouse for analytics, a search engine for search, etc.
The traditional approach to syncing MySQL with complementary data stores is batch-based, where pipelines extract data from MySQL and send it to downstream data stores. Change data capture (CDC) is a modern alternative to inefficient bulk imports. CDC extracts change events (INSERTs, UPDATEs, and DELETEs) in real-time from data stores, such as MySQL, and provides them to downstream systems which can be applied to a copy of the data.
Decodable + MySQL CDC
Decodable can take input from a MySQL database as a source using the MySQL CDC (Change Data Capture) connector which converts table changes into a stream of change records. Decodable can be a super convenient means to replicate the contents of a MySQL database into a range of systems including messaging such as Kafka, analytical databases such as Apache Pinot, or machine learning feature stores. Decodable's SQL-on-the-stream transformation process also includes data virtualization on change streams so you're processing against the table, not the change records. In the following demo you can see MySQL data replicated to ClickHouse using the Decodable MySQL CDC connector and a transformation in a Decodable pipeline.
