Data Center Network Infrastructure Engineer

About the Job: On behalf of our client, a global tech leader, we are seeking a Data Center Network Infrastructure Engineer to help build a cutting-edge on-premises GPU infrastructure designed specifically for high-performance AI and Large Language Model (LLM) workloads. In this role, you will serve as the technical backbone of this initiative, taking complete end-to-end ownership from physical facility readiness and high-speed GPU network fabrics to secure hybrid cloud integrations.

Offering full flextime with regular visits to Tokyo data center facilities, this position provides highly competitive, market-leading remuneration and is structured as a long-term contract with an option to convert to permanent employment .

Must-Haves & Non-Negotiables

• Japanese Language Ability: Native or Fluent Japanese proficiency (CEFR C1 required) to collaborate effectively with internal stakeholders, data center vendors, and System Integrators, including evaluating SI technical proposals.
• Network Design: Hands-on experience in the design, build, and management of data center network fabrics (BGP, VLAN/VRF segmentation, ASN planning, and RoCE/InfiniBand).
• Automation: Production-level experience with Infrastructure as Code (IaC) workflows and hands-on scripting in Python or Bash.
• Communication & Stakeholder Management: Proven capability to lead technical alignment, coordinate site readiness, manage lead times, and interface across diverse engineering and business teams.

What You Will Be Doing

• Design & Deploy Infrastructure: Design, build, and operate on-premises data center facilities and high-density GPU infrastructure, managing power allocation, cooling systems, rack topologies, and high-performance network fabrics.
• Build GPU Workload Networks: Architect and manage specialized GPU networks, including in-band service networks, isolated out-of-band management networks, and high-speed InfiniBand or RoCE fabrics.
• Routing & Architecture: Architect BGP routing alongside OSPF/IS-IS and VLAN/VRF segmentation, overseeing ASN planning, route summarization, and traffic policies.
• Vendor & Facility Management: Coordinate directly with data center providers and system integrators regarding site readiness, lead times, remote hands, procurement, hardware delivery, and physical cabling.
• Hybrid Cloud Integration: Securely integrate on-premises GPU clusters with Google Cloud Platform (GCP), Amazon Web Services (AWS), and corporate platforms.
• Automate & Monitor: Implement Infrastructure as Code (IaC) via Python/Bash, establish centralized logging, monitoring, and automated alerting, and ensure seamless operational handoffs.

What We Need To See

• Networking Fundamentals: Solid foundation in networking principles with recent hands-on experience in data center routing and switching (BGP, OSPF, VLAN/VRF, routers, switches, firewalls).
• Physical Operations: Practical experience with server racks, high-density power distribution, cooling systems, structured cabling, and remote hands coordination.
• System & Cloud Administration: Hands-on experience managing production Linux environments and a proven track record of integrating on-premises environments with AWS or GCP.

Ways To Stand Out From The Crowd

• HPC & GPU Expertise: Prior experience with High-Performance Computing (HPC) or GPU infrastructure, specifically InfiniBand or RoCE network architectures.
• NVIDIA DGX Systems: Direct experience handling NVIDIA DGX systems or comparable high-density GPU appliances.
• Hardware Operations: Hands-on management using BMC, Redfish, IPMI, and smart PDU interfaces.
• AI/LLM Stack Familiarity: Understanding of machine learning or LLM serving infrastructure and GPU workload scheduling systems.
• Software Engineering: Software development exposure using Go.

Why You will Love Working Here

• Global Tech Company: Work at the forefront of AI innovation with a premier global technology leader shaping next-generation LLM platforms.
• World's Best Team: Collaborate alongside world-class engineers, AI researchers, and core infrastructure experts in an environment driven by high engineering standards.
• Amazing Facilities & Remuneration: Enjoy top-tier, highly competitive compensation together with state-of-the-art office facilities and modern data center environments.
• Learning & Growth Opportunity: Expand your technical breadth on high-density GPU architectures, specialized cooling designs, and cutting-edge network fabrics.
• Flexibility & Comfort: Benefit from full flextime policies designed to give you ownership over your schedule and work-life balance.

Remuneration & Engagement Terms

• Compensation: Great remuneration package, highly competitive within the market.
• Contract Term: Long-term contract with stability and structured renewals, offering an option to transition into a permanent position.

Don't Wait – Apply Today!

This role is moving exceptionally fast. Please apply directly or reach out to me immediately to schedule your screening session and technical assessment as early as possible.