confluent-cloud-cdc-tableflow
Set up end-to-end Change Data Capture (CDC) pipelines on Confluent Cloud using Debezium source connectors, Flink for transformation, and Tableflow for data lake integration. Supports JSON_SR, Avro, and Protobuf formats. Handles schemaless topics (plain JSON without SR) and multi-event topics. This skill handles the complete workflow from database to Iceberg/Delta tables. Use this skill when users want to capture database changes and materialize them into Iceberg or Delta Lake tables via Confluent Cloud Tableflow. Trigger phrases include "CDC to Tableflow", "database to Iceberg", "database to Delta Lake", "stream database changes to data lake", "set up Tableflow pipeline", "schemaless topic to Tableflow", or "multi-event topic to Iceberg". Do NOT trigger for general CDC, Debezium, or database replication requests that do not involve Tableflow or Iceberg/Delta Lake as the destination.
Install
With your agent
Install OMGSkills skill "confluentinc/agent-skills:skills/confluent-cloud-cdc-tableflow" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/confluentinc/agent-skills /tmp/agent-skills && ln -s /tmp/agent-skills/skills/confluent-cloud-cdc-tableflow ~/.claude/skills/confluent-cloud-cdc-tableflowFrom README
Confluent Cloud CDC to Tableflow Pipeline Build production-ready Change Data Capture pipelines that stream database changes through Confluent Cloud to Iceberg or Delta Lake tables using Debezium, Flink, and Tableflow. Overview This skill automates the of a complete CDC pipeline: Database → Debezium CDC Connector → Kafka + Schema Registry → Flink (decode & transform) → Tableflow → Iceberg/Delta Tables Supported Databases (Fully-Managed Debezium Connectors Only) Microsoft SQL Server CDC Source V2 MySQL CDC Source V2 PostgreSQL CDC Source V2 Oracle XStream CDC Source DynamoDB CDC Source Key Components Debezium CDC Source Connector: Captures database changes as events Schema Registry: Manages Avro/JSON/Protobuf schemas (default: JSONSR) Confluent Cloud Flink: Decodes Debezium envelopes and transforms data Tableflow: Native Confluent Cloud feature that materializes Kafka topics as Iceberg or Delta tables Critical Architecture Rules 1. NEVER enable Tableflow directly on CDC source topics.
More from this repo
confluent-cloud-flink-sql
Used to write and debug Flink SQL that runs on Confluent Cloud, enforcing the CC-vs-Apache-Flink (OSS) dialect boundary.
confluent-tuning-advisor
Advisory-only Kafka tuning for Confluent Cloud or Confluent Platform by priority: latency, throughput, availability, or...
developing-kafka-java-client
Used when the user wants to integrate a Kafka client into an existing application or scaffold a Java Kafka client...