Big Data Platform Engineer

1. Azure Kubernetes Service (AKS)
   Strong Expertise
   • AKS cluster deployment and administration
   • Cluster upgrades and patch management
   • Node pool management
   • Ingress Controllers (NGINX/Application Gateway)
   • RBAC implementation
   • AKS security hardening
   • Autoscaling (HPA/VPA/Cluster Autoscaler)
   • Persistent storage management
   • Troubleshooting cluster issues
   • Network policiesExperience
   • Production support of AKS environments
   • Multi-node and multi-environment AKS setups
   • High availability and disaster recovery implementation
2. Kubernetes Networking
   Strong Knowledge
   • Kubernetes networking concepts
   • Services, Ingress, Load Balancers
   • DNS resolution
   • Pod-to-Pod communication
   • Pod-to-Service communication
   • Network Policies
   • Service Mesh concepts (Istio preferred)
   • CNI ArchitectureAzure Networking
   • Virtual Networks (VNet)
   • Subnets
   • Private Endpoints
   • Peering
   • NSG
   • UDR
   • Azure Firewall
   • VPN connectivity
3. Docker Containerization
   Must Have
   • Docker image creation and optimization
   • Container lifecycle management
   • Registry management
   • Security scanning
   • Multi-stage builds
   • Container troubleshootingRegistries
   • Azure Container Registry (ACR)
   • Image versioning and governance
4. Azure DevOps
   CI/CD Expertise
   • Azure DevOps Pipelines
   • YAML pipelines
   • Build and Release pipelines
   • Git repositories
   • Branching strategiesInfrastructure Deployment
   • Infrastructure as Code
   • ARM Templates
   • Bicep
   • Terraform (preferred)Automation
   • Deployment automation
   • Environment promotion
   • Release management
5. Monitoring Observability
   • Azure Monitor
   • Log Analytics
   • Application Monitoring
   • AKS Monitoring
6. Event Streaming Platform
   • Azure Event Hub
7. Azure Functions
8. Apache NiFi
9. Infrastructure as Code

• Manage and support AKS-based Big Data platform infrastructure.
• Administer NiFi, Event Hub, and Azure Functions.
• Implement and maintain CI/CD pipelines using Azure DevOps.
• Monitor platform health using Azure Monitor and Log Analytics.
• Troubleshoot platform, networking, and infrastructure issues.
• Implement infrastructure automation through Terraform/Bicep.
• Ensure platform security, governance, and compliance.
• Collaborate with Data Engineering teams for platform enablement.
• Perform upgrades, patching, capacity planning, and optimization.
• Support production incidents and platform reliability initiatives.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.