AWS MSK Migration Engineer

Kafka to AWS MSK Migration Engineer at N Consulting Ltd

Role: Kafka to AWS MSK Migration Engineer
Experience: 5+ years
Location: Bengaluru, Hyderabad

Roles and Responsibilities:

Technical Competencies

Candidates are not expected to be experts in every tool, but should bring strong hands-on experience across several of the following areas:

AWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, CloudWatch, and related cloud services.

Apache Kafka: Deep hands-on experience with Kafka architecture including brokers, topics, partitions, consumer groups, replication, and cluster operations.

AWS MSK: Practical experience with Amazon Managed Streaming for Apache Kafka including cluster provisioning, configuration, monitoring, and security (IAM, mTLS, SASL/SCRAM).

Migration Tooling: Experience with MirrorMaker 2, Confluent Replicator, or similar cross-cluster replication tools for data migration and offset synchronization.

Cloud Migration: Practical understanding of on-prem to cloud migration strategies, workload assessment, testing, cutover, and post-migration validation.

Kafka Ecosystem: Familiarity with Schema Registry, Kafka Connect, Kafka Streams, and related ecosystem components.

Networking and Security: Understanding of VPC peering, PrivateLink, TLS encryption, IAM policies, and network connectivity patterns for hybrid Kafka architectures.

Programming and Automation: Experience with Python OR Java, Shell, or similar languages to build scripts, utilities, and automation frameworks for topic creation, ACL migration, and consumer group management.

Work experience CI/CD pipelines, Jenkins , Docker, Kuberneties

APIs and Integration: Working knowledge of RESTful APIs, API design, and API Gateway patterns.

CI/CD and Version Control: Strong experience with GitLab, Jenkins, Maven, or similar tools supporting automated build, test, and deployment pipelines.

Observability: Familiarity with monitoring, logging, alerting, and troubleshooting using tools such as CloudWatch, Prometheus, Grafana, Splunk, or equivalent platforms for Kafka/MSK cluster health.

Automation Excellence: Ability to design repeatable automation and apply AI-assisted engineering approaches to improve migration scale, quality, and efficiency.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.