Kafka CDC Engineer

• We are looking for an experienced Kafka CDC Engineer with strong hands-on expertise in Apache Kafka, Kafka Connect, Debezium CDC, and Oracle.
• The candidate will be responsible for implementing and supporting real-time Change Data Capture (CDC) pipelines, enabling data movement from Oracle databases to Kafka and downstream platforms such as Databricks/Data Lakes.
• The ideal candidate should have strong understanding of Kafka topics, source/destination connectivity, event/data handling, schema evolution, and production support.

Key Responsibilities

• Implement and configure Debezium CDC for capturing changes from Oracle 19c/21c logs and APIs.
• Configure Kafka Connect and Debezium connectors for Oracle-to-Kafka data pipelines.
• Design and configure Apache Kafka topics to capture and distribute database change events.
• Manage CDC event flow from Oracle tables
• Debezium
• Kafka topics
• downstream systems.
• Configure and troubleshoot source and destination connections for Kafka-based data pipelines.
• Integrate Kafka CDC pipelines with Databricks, Data Lake, and other downstream data platforms.
• Handle schema evolution, data validation, data consistency, and transformation requirements.
• Monitor Kafka topics, connectors, consumer/producer activity, and CDC pipelines in production.
• Troubleshoot production incidents related to Kafka, Debezium, Kafka Connect, Oracle connectivity, offsets, lag, and data discrepancies.
• Perform root-cause analysis and implement permanent fixes for production issues.
• Optimize Kafka and CDC pipeline performance, throughput, and reliability.
• Develop and maintain SQL/PLSQL and Shell scripts for data validation, automation, and operational activities.
• Work with Linux environments for deployment, monitoring, troubleshooting, and automation.
• Collaborate with application, database, cloud, and data engineering teams to ensure reliable end-to-end data flow.

Mandatory Skills

• 5-8 years of relevant experience in Data Engineering / Streaming / CDC.
• Strong hands-on experience with Apache Kafka.
• Strong experience with Debezium CDC.
• Hands-on experience with Kafka Connect.
• Experience implementing Oracle-to-Kafka CDC pipelines.
• Strong understanding of Kafka topics, partitions, offsets, producers, consumers, and event processing.
• Experience with Oracle 19c/21c.
• Strong SQL/PLSQL skills.
• Good experience with Linux and Shell Scripting.
• Experience in production support, incident management, troubleshooting, and RCA.
• Strong understanding of source-to-target data flow and connectivity.
• Experience with data validation and schema evolution.

Preferred Skills

• Databricks / Data Lake AWS Kubernetes Confluent Platform CI/CD Experience with Kafka monitoring and performance tuning.
• Experience integrating Kafka CDC with cloud-based data platforms.

Location

• Pan India,Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune