Kafka Administrator

Job Title: Kafka Administrator / Confluent Kafka Engineer

Job Type: Full-time

Experience: 3+ Years

About the Role:

We are looking for a skilled and proactive Confluent Kafka Administrator / Engineer with over 3 years of experience managing and supporting distributed streaming platforms. The ideal candidate will have hands-on experience in administering Kafka clusters, implementing security and automation practices, and ensuring seamless data integration across cloud-native environments.

You will be responsible for maintaining high availability and performance of our Kafka infrastructure, managing Kafka Connectors, integrating with AWS and DevOps tools, and providing production support.

Key Responsibilities:

• Design, deploy, and administer multi-node Confluent Kafka clusters ensuring high availability and fault tolerance.
• Manage Kafka Connect (Source & Sink) for efficient data streaming across systems.
• Implement and maintain Kafka security features including SSL/TLS, SASL, and ACL configurations.
• Automate Kafka cluster operations and topic/user provisioning using Ansible and CI/CD pipelines (Jenkins, GitLab).
• Monitor and optimize Kafka performance using Prometheus, Grafana, Splunk, and Confluent Control Center (C3).
• Plan and execute cluster upgrades, patch management, and zero-downtime migrations.
• Provide 24/7 production support, troubleshoot issues, and collaborate with Confluent Support to resolve incidents.
• Support the integration of producer/consumer applications and ensure proper consumer rebalancing.
• Manage schema registry, Kafka log files, and Zookeeper cluster configurations.
• Work closely with DevOps and cloud teams for container orchestration (Docker, Kubernetes) and cloud provisioning (AWS, Azure, GCP).
• Manage AWS services such as MSK, EC2, IAM, S3, CloudWatch, RDS, EKS, and Opensearch.

Required Skills & Experience:

• 3+ years of hands-on experience in Confluent Kafka administration and support.
• Strong expertise in Kafka Connect, Zookeeper, Schema Registry, Kafka Streams, and KSQL.
• Proficient with AWS Cloud Services including MSK, EC2, IAM, S3, CloudWatch, and EKS.
• Working knowledge of Linux-based environments (Amazon Linux, Red Hat).
• Experience with DevOps tools: Jenkins, GitLab, Ansible, Docker, and Kubernetes.
• Solid scripting knowledge in Python, Bash/Shell scripting, and familiarity with SQL.
• Exposure to CI/CD pipelines and automation of Kafka-related tasks.
• Strong analytical and troubleshooting skills with a focus on performance and reliability.
• Excellent communication skills and experience working with support teams and cross-functional stakeholders.

Preferred Qualifications:

• Experience working with Confluent Support for enterprise Kafka issues.
• Knowledge of MongoDB, MySQL, Oracle, and data integration practices.
• Familiarity with Azure or GCP cloud platforms.

Education:

• Bachelors Degree in Computer Science or related field
• BE – Computer Science, Mumbai University (CGPA: 8.16)