Data engineer Lead

• Design, develop, and maintain real-time data pipelines using Apache Flink and Apache Kafka. • Develop production-grade streaming applications for high-volume and low-latency workloads. • Implement data transformation, filtering, enrichment, aggregation, and event processing. • Build reliable event-processing pipelines with appropriate error handling and recovery mechanisms. • Consume and publish events across Kafka topics. • Implement appropriate partitioning, consumer groups, offsets, and delivery mechanisms. • Troubleshoot streaming pipeline failures and performance issues.

Preferred candidate profile

Apache Flink • Develop and maintain Apache Flink jobs for real-time data processing. • Implement: o Stream transformations