Senior Staff Machine Learning Engineer

Senior Staff Machine Learning Engineer

San Jose, CA, USA

12 Months

$70/HR on W2 OR $80/HR on C2C

Any visa is fine

Need candidates who are in California. W2 candidates are encouraged to apply.

Client is an AI-enhanced security processor company redefining the control and management of every digital system. The company builds silicon-rooted security and management chips — including the TCU (Trusted Control/Compute Unit) — for AI data center infrastructure, combining platform security, BMC/firmware, and on-chip AI for real-time threat detection and dynamic power/thermal management.

Job Description

About the role

We’re looking for an ML engineer who works across the full stack from model to silicon — comfortable optimizing training and inference performance on GPU/AI-accelerator infrastructure, building or tuning models, and adapting model and inference-engine design to the constraints of the underlying chip and its NPU. You’ll move fluidly between algorithm work, systems-level software, and infrastructure work, closing the loop end-to-end rather than owning just one layer of the stack. This is a rare chance to work the full cycle of AI silicon, from model down to chip — something most ML engineers at large companies never get access to.

What you’ll do

• Optimize training and inference performance across GPU and AI-accelerator infrastructure, including MLOps pipelines

• Design, train, and evaluate ML models (deep learning, LLM, CV, or recommendation systems) and take them into production

• Harden and extend NPU cores (e.g. building on an open RVV/tensor core like CoralNPU) into production silicon

• Build or optimize inference engines and serving runtimes against real hardware constraints — latency, memory, and power

• Work below the application layer where needed — BMC firmware, embedded Linux, or RTOS (e.g. Zephyr) — so AI features run reliably on real systems

• Build automated test/verification harnesses that close the loop for AI-assisted RTL/DV, hardware bring-up, or manufacturing test

• Apply ML to security — AI-driven log/intrusion analysis, AI-assisted penetration testing, or firmware/hardware security work

• Collaborate closely with RTL/hardware, firmware, and QA teams to ship AI features end-to-end, from training through deployment and monitoring

Requirements:

• 8-10+ years of hands-on AI/ML experience; Master’s required, PhD preferred

• Hands-on experience with AI/ML infrastructure and performance — GPU clusters, distributed training, inference-serving optimization, MLOps pipelines

• Model / algorithm development experience — designing, training, and evaluating ML models

• Experience taking models into production — feature engineering, data pipelines, deployment

• AI chip / hardware-aware ML experience — optimizing inference engines for a specific chip, or adapting model architecture/quantization to chip constraints

• Deep, hands-on expertise in at least 2 of the following 5 specialty areas — we don’t expect all five:

– NPU / AI-accelerator — hardening or extending an NPU core into production silicon, mapping models onto MAC/tensor-engine constraints, or NPU-aware RTL/DV work

– Systems / Sys-level software — BMC firmware, embedded Linux, RTOS (e.g. Zephyr), or other low-level system software

– Inference engine / runtime — built or materially optimized an inference engine or serving runtime against real hardware constraints

– Test / verification harness — built an automated harness that closes a loop, e.g. an agent-driven RTL/DV test runner or a hardware bring-up / MFG test harness

– Cyber security — AI-driven log/intrusion analysis, AI-assisted penetration testing, or firmware/hardware security