Consultant - Database Administrator

Job Title

Consultant - Database Administrator

Job Summary

The Data Platform Engineer - Streaming Platforms is responsible for the administration, reliability, security, and operational support of enterprise Apache Kafka environments. This role is intended for an experienced Kafka Administrator with 4-8 years of overall IT experience and hands-on experience administering Apache Kafka platforms. The engineer will install, configure, administer, monitor, troubleshoot, tune, and upgrade Kafka clusters that support business-critical real-time streaming workloads. The role works closely with application, data engineering, infrastructure, security, and production support teams to maintain stable, secure, and highly available streaming services.

Responsibilities

• Install, configure, administer, maintain, and upgrade Apache Kafka clusters across enterprise environments.
• Monitor Kafka platform health, availability, capacity, and performance; troubleshoot platform issues and implement performance-tuning recommendations.
• Create, configure, and manage Kafka topics, partitions, replication factors, retention settings, and other cluster resources.
• Manage and troubleshoot producers, consumers, offsets, and consumer groups to support reliable message processing.
• Implement and maintain Kafka security using SSL/TLS, SASL, and Access Control Lists (ACLs).
• Support production Kafka environments, participate in incident troubleshooting, perform root-cause analysis, and assist with service restoration.
• Analyze Kafka, broker, operating-system, and application logs to identify and resolve production issues.
• Perform routine platform maintenance, patching, upgrades, capacity planning, and operational health checks.
• Support high availability, replication, resiliency, backup/recovery, and disaster-recovery requirements for streaming platforms.
• Use Linux/Unix administration and Shell scripting to support platform operations and automate repetitive administrative tasks.
• Maintain operational documentation, runbooks, configuration standards, troubleshooting procedures, and platform inventories.
• Collaborate with application and engineering teams to onboard new Kafka use cases and resolve platform integration issues.
• Support Kafka environments using ZooKeeper and/or KRaft architecture and participate in platform modernization activities.

Education Experience

• 8-13 years of overall Information Technology experience.
• Hands-on experience with Apache Kafka administration in production or enterprise environments.
• Experience with Kafka cluster installation, configuration, administration, maintenance, and upgrades.
• Strong knowledge of Kafka topics, partitions, replication, brokers, producers, consumers, offsets, and consumer groups.
• Experience monitoring, troubleshooting, and performance tuning Kafka clusters and streaming workloads.
• Hands-on knowledge of Kafka security, including SSL/TLS, SASL authentication, and ACL based authorization.
• Working knowledge of Linux/Unix environments and Shell scripting.
• Experience supporting production systems and troubleshooting incidents in business critical environments.
• Knowledge of Apache ZooKeeper and Kafka KRaft architecture.
• Effective written and verbal communication skills and the ability to collaborate across technical teams.

Must Have Skills

• Kafka cluster installation, configuration, administration, and upgrades
• Monitoring, troubleshooting, and performance tuning
• Topics, partitions, replication, and consumer group management
• Kafka security - SSL/TLS, SASL, and ACLs
• Linux/Unix and Shell scripting
• Production support and incident troubleshooting
• ZooKeeper/KRaft architecture

Nice to Have Skills

• Hands-on experience with Confluent Kafka or Confluent Platform.
• Experience with Kafka Connect and connector administration.
• Experience administering or supporting Schema Registry.
• Experience with Prometheus and Grafana for Kafka monitoring, metrics, dashboards, and alerting.
• Experience with automation, CI/CD, Infrastructure-as-Code, or scripting used to operate streaming platforms.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.