Platform Engineer - Kubernetes & Data Platform

Are you a Platform Engineer passionate about Kubernetes and Data Engineering? Torry Harris is looking for a skilled Platform Engineer to join our team and help build a next-generation, on-premises Kubernetes Data Platform powering large-scale data processing, AI/ML workloads, real-time analytics, and self-service data capabilities.

As a Platform Engineer, you will design, build, automate, operate, and scale the platform using Kubernetes, Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage. You’ll work closely with Platform and Data Engineering teams to build a secure, resilient, scalable, and multi-tenant platform that enables strategic data initiatives.

Roles and Responsibilities

• Design, build, and operate **production-grade, on-premises Kubernetes platforms** for data-intensive and AI/ML workloads.

• Deploy, manage, and optimize **Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage** on Kubernetes.

• Build scalable, resilient, secure, and **multi-tenant platform architectures** with self-service capabilities for Data Engineering and AI/ML teams.

• Implement **GitOps and automation** using Argo CD, Helm, Infrastructure as Code, and CI/CD pipelines for platform provisioning, deployment, upgrades, and lifecycle management.

• Enable data lake, real-time analytics, AI/ML use cases, and migration of workloads from **legacy Hadoop to Kubernetes-native platforms**.

• Establish platform **monitoring, observability, alerting, capacity management, backup, and disaster recovery** practices.

• Troubleshoot complex production issues, lead **Root Cause Analysis (RCA)**, and drive continuous improvements in platform reliability and performance.

• Implement **Kubernetes security, RBAC, secrets, certificates, network policies, governance, and compliance** controls.

• Collaborate with Platform, Data Engineering, AI/ML, Infrastructure, and Security teams to deliver strategic **Data Platform initiatives** and engineering best practices.