Hardware Engineer

Job Description & Requirements

We are seeking an experienced AI Hardware Engineer to support the design, deployment, validation, and troubleshooting of AI training clusters, GPU servers, networking, and storage infrastructure. The ideal candidate should have strong expertise in server hardware, GPU platforms, high-speed networking, and data center infrastructure to support large-scale AI/HPC environments.

Key Responsibilities

AI Server Hardware Management

• Deploy, validate, and maintain AI GPU servers;
• Perform hardware diagnostics and component replacement;
• Analyze system logs, BMC logs, and hardware alerts;
• Manage server hardware lifecycle.

GPU Platform Support

• Deploy and validate NVIDIA GPU platforms;
• Troubleshoot GPU-related;
• Perform GPU benchmarking and stress testing;
• Support CUDA, NCCL, and GPU fabric troubleshooting.

AI Cluster Deployment & Validation

• Participate in AI/HPC cluster deployment;
• Execute cluster hardware qualification testing;
• Produce validation reports and documentation.

Network & Storage Support

• Configure and maintain high-speed networking:
• Support distributed storage systems:
• Assist with performance analysis and troubleshooting.

Automation & Tool Development

• Develop automation scripts for:
• Hardware health checksCluster validationDeployment automationLog collection
• Build tools for testing and operations.
• Good communication, teamwork, and ownership mindset.
• Willing to participate in on-call rotation, maintenance windows, and emergency incident response, willing to accept short-term business trips.

Required Qualifications

Bachelor's degree or above in Computer Engineering, Electrical Engineering, Telecommunications, or related fields.

Hardware

• Strong knowledge of x86 server architecture;

• Familiar with Intel, AMD, and NVIDIA Grace CPU platforms;

• Experience with:

• HGX

• DGX

• GB200 NVL72

• GB300 NVL72

• Knowledge of BMC/IPMI management.GPU & AI Platform

• Experience with NVIDIA GPU products H100, H200, B200, B300

• Familiar with: CUDA ,NCCL ,NV Link ,NV Switch and GPU Direct RDMA

Linux

• Strong Linux administration skills (Ubuntu, Rocky Linux);
• Proficient in: Shell ,Python , Bash
• Capable of independent troubleshooting.

Networking: Strong understanding of: TCP/IP , VLAN , BGP ,OSPF ,RDMA , InfiniBand and RoCE

Preferred Qualities

• Experience operating AI training clusters; Kubernetes experience; Slurm administration
• PXE deployment experience; GPU Fabric Manager expertise;
• Experience with hyperscale AI datacenter deployments.

Pay: $4,500.00 - $7,500.00 per month

Work Location: In person