Software Engineer

AI Systems Engineer (Local LLM / Factory DX)

Location: Toki Plant, MARUWA

Employment Type: Full-time

Why We’re Hiring

Our factory is accelerating digital transformation (DX) to maximize production efficiency and advance smart‑factory initiatives. Recently, we introduced an on‑premise GPU infrastructure for AI model validation. This enables us to reduce reliance on external cloud services and build secure, closed‑network local AI systems — including local LLM serving and RAG‑based knowledge systems . To drive practical innovation in manufacturing, we are seeking a core AI engineer who can go beyond theoretical research and integrate factory data, legacy systems and modern AI technologies to deliver real productivity impact.

What You Will Do

You will lead the development and operation of local AI systems running on our in‑factory GPU servers. This includes deploying open‑source LLMs, building MLOps pipelines, and managing AI implementation projects across the production floor.

Key Responsibilities

• System Integration & API Development Build and implement solutions such as automated inventory‑linked ordering, safety enhancement via AI cameras, and AGV/AMR‑based internal logistics automation.
• Local LLM Infrastructure Development Deploy and optimize open‑source LLMs (vLLM, Ollama, etc.) in local/on‑premise environments, ensuring high‑performance real‑time inference.
• Model Optimization & Fine‑Tuning Execute quantization and domain‑specific fine‑tuning to maximize hardware efficiency and adapt models to manufacturing use cases.
• RAG Pipelines & Internal AI Services Develop internal knowledge‑based chatbots that integrate manuals, process data, and safety guidelines to support factory operations.

Why This Role Is Exciting

• Hands-on experience with cutting-edge local AI infrastructure You will directly design and operate high‑performance GPU systems — not just call cloud APIs — gaining rare, high‑value expertise in on‑premise AI architecture.
• Lead core DX initiatives You will be a central member driving automation, smart logistics, and safety innovation across the factory, shaping the future of manufacturing operations.

Expected Contributions

• Internalization of AI Capabilities Build stable, customizable AI models and inference systems tailored to factory needs, reducing dependence on external vendors.
• Bridge Engineer Role Collaborate closely with on-site engineers and IT administrators, translating operational challenges into technical requirements and delivering practical AI solutions.

Required Qualifications:

Must-Have

• Experience operating Linux environments (NVIDIA DGX Spark / Ubuntu) and building/maintaining Docker-based container systems.
• Hands-on experience deploying open-source LLMs (vLLM, Ollama, etc.) in local/on-premise environments and serving them via API.
• Practical development experience using Python and AI frameworks such as PyTorch (or equivalent skill level).
• Experience with LLM quantization, fine‑tuning, and designing/building RAG pipelines.
• Japanese Language Proficiency at least N2 level by JLPT

Nice-to-Have

• Experience operating high-performance GPU servers or large-scale data processing infrastructure.
• Basic knowledge of enterprise networking (TCP/IP, VLAN) and manufacturing communication protocols (MQTT, etc.).
• Experience in smart‑factory solution development or manufacturing DX projects.
• English proficiency (business level or higher)

P.S. This position is open exclusively to candidates currently residing in Japan.

★★★Please send your Japanese format CVs in PDF★★★