Kafka Integration Specialist

We are seeking a highly skilled Kafka Integration Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and integrating Apache Kafka solutions to support real-time data streaming and distributed systems.

Key Responsibilities :

• Design, implement, and maintain Kafka-based data pipelines.

• Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies.

• Manage Kafka clusters, ensuring high availability, scalability, and performance.

• Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.

• Implement best practices for data streaming, including message serialization, partitioning, and replication.

• Monitor and troubleshoot Kafka performance, latency, and security issues.

• Ensure data integrity and implement failover strategies for critical data pipelines.

Required Skills :

• Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).

• Proficiency in programming languages like Java, Python, or Scala.

• Experience with distributed systems and data streaming concepts.

• Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.

• Expertise in creating and managing topics, partitions, and consumer groups.

• Hands-on experience with integration tools such as REST APIs, MQ, or ESB.

• Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.

Nice to Have :

• Experience with monitoring tools like Prometheus, Grafana, or Datadog.

• Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation.

• Knowledge of data serialization formats like Avro, Protobuf, or JSON.

Qualifications :

• Bachelor's degree in Computer Science, Information Technology, or related field.

• 4+ years of hands-on experience in Kafka integration projects.