Senior Software Engineer-Senior Cloud Data Engineer

Senior Cloud Data Engineer

KEY ACCOUNTABILITIES:

• Administer, monitor, and support Confluent Kafka Platform environments, ensuring high availability, performance, scalability, and security.

• Install, configure, upgrade, patch, and maintain Kafka brokers, ZooKeeper/KRaft, Schema Registry, Kafka Connect, Control Center, Flink and REST Proxy.

• Deploy, manage, and troubleshoot Kafka Connect source and sink connectors including CDC, JDBC, S3/ADLS, IBM MQ, and REST connectors.

• Manage platform infrastructure on PAAS/IaaS environments (Azure, AWS, or On-Premises Linux servers), including capacity planning and performance tuning.

• Automate Kafka platform provisioning, deployment, and operational activities using Ansible and Infrastructure as Code practices.

• Monitor platform health, consumer lag, broker performance, connector status, and proactively resolve incidents and production issues.

• Implement security controls including SSL/TLS, RBAC, LDAP/AD integration, Secrets Management, and encryption standards.

• Perform disaster recovery testing, backup validation, platform upgrades, and infrastructure maintenance activities.

• Raise and manage ServiceNow incidents, service requests, change requests, and support audit/compliance requirements.

• Collaborate with application, infrastructure, cloud, and data engineering teams to onboard and support enterprise streaming use cases.

  . FRAMEWORKS, BOUNDARIES, & DECISION MAKING AUTHORITY:

• Functions within the framework and boundaries of Group policies as well as overall organisational and governance frameworks.

• Authorised to take decisions as per the approved authorisation matrix.

Minimum Qualification

• 4-6 years of experience in Confluent Platform administration and support.
• Strong experience with Confluent Platform components including Kafka Brokers, Schema Registry, Kafka Connect, Control Center, and ksqlDB/Flink.
• Hands-on experience with Flink for stream processing and real-time data pipelines.
• Experience managing Linux-based infrastructure in Azure, AWS, or other IaaS platforms.
• Strong automation and scripting experience using Ansible, Shell Scripting, or Python.
• Experience with SSL, RBAC, LDAP, authentication, authorization, and Kafka security best practices.
• Knowledge of monitoring tools such as Prometheus, Grafana, Splunk, or ELK.
• Experience with CI/CD pipelines and infrastructure automation.
• Strong troubleshooting, problem-solving, and stakeholder communication skills.

Experience in implement application self-healing solutions through proactive and reactive automated measures

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.