Senior Infrastructure Security Engineer – AI/GPU Cluster

Job Summary
We are looking for an experienced Infrastructure Security Engineer to design, implement, and maintain security controls for a large-scale AI/GPU computing cluster.
This role will work closely with infrastructure, network, storage, platform, and operations teams to protect the cluster environment across compute nodes, Kubernetes workloads, network infrastructure, storage systems, and management platforms.
The ideal candidate has hands-on experience securing large-scale Linux and cloud-native infrastructure, with strong knowledge of Kubernetes security, network security, identity and access management, vulnerability management, and security automation.
Key Responsibilities

• Design and implement security architecture for large-scale AI/GPU cluster infrastructure.
• Secure Linux-based compute nodes, management servers, and supporting infrastructure.
• Implement Kubernetes and container security controls, including RBAC, network policies, secrets management, workload isolation, image security, and runtime protection.
• Design and maintain network security controls, including firewall policies, ACLs, network segmentation, VPN, IDS/IPS, and secure management networks.
• Establish identity and access management policies, including RBAC, MFA, service accounts, privileged access, and least-privilege controls.
• Perform vulnerability scanning, security assessment, CVE management, patch coordination, and configuration hardening.
• Build monitoring, logging, alerting, and security incident detection capabilities across the cluster environment.
• Support security incident investigation, root cause analysis, remediation, and post-incident improvements.
• Develop security automation using scripting and Infrastructure-as-Code tools.
• Collaborate with networking, storage, SRE, DevOps, platform, and data center operations teams to integrate security into infrastructure design and deployment.
• Define and maintain security standards, hardening guidelines, operational procedures, and security documentation.
• Continuously evaluate emerging threats and security risks related to AI infrastructure, GPU clusters, distributed systems, and cloud-native environments.

Required Qualifications

• 5+ years of experience in infrastructure security, cloud security, platform security, network security, or a related field.
• Strong Linux system administration and Linux security experience.
• Hands-on experience with Kubernetes and container security.
• Strong understanding of network security concepts, including firewalls, ACLs, VLANs, routing, network segmentation, and secure remote access.
• Experience with IAM, RBAC, MFA, privileged access management, and secrets management.
• Experience with vulnerability management, patching, system hardening, and security baselines.
• Experience with security monitoring, logging, SIEM, IDS/IPS, or endpoint/runtime security solutions.
• Familiarity with Python, Bash, Ansible, Terraform, or similar automation tools.
• Strong understanding of security principles such as least privilege, Zero Trust, defense-in-depth, and secure-by-design infrastructure.
• Strong troubleshooting skills and ability to work across multiple infrastructure teams.

Preferred Qualifications

• Experience securing HPC, AI, GPU, or large-scale distributed computing environments.
• Experience with NVIDIA DGX or similar GPU computing platforms.
• Familiarity with InfiniBand, RoCE, RDMA, or high-performance networking.
• Experience with multi-tenant cluster security and workload isolation.
• Familiarity with security tools such as HashiCorp Vault, Falco, Trivy, Aqua, Prisma Cloud, CrowdStrike, Splunk, Elastic, or similar technologies.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of security compliance frameworks such as SOC 2, ISO 27001, NIST, or CIS benchmarks.
• Security certifications such as CISSP, CCSP, OSCP, CKS, or equivalent are a plus.

Technical Keywords
Linux Security, Kubernetes Security, Container Security, Infrastructure Security, Platform Security, Network Security, IAM, RBAC, Zero Trust, Vulnerability Management, SIEM, IDS/IPS, DevSecOps, Terraform, Ansible, Python, GPU Cluster, HPC, InfiniBand, RoCE, RDMA, NVIDIA DGX

Pay: From $77,800.00 per year

Work Location: In person