AI Backend Engineer

Job title:

AI Backend Engineer

Job type:

Permanent

Emp type:

Full-time

Job published:

16-07-2026

Job ID:

42777

Contact name:

Reynard Seng, Talitha Celsyah

Contact email:

[email protected], [email protected]

Job Description

AI Backend Engineer

Job Summary:

As an AI Backend Engineer, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

Job Responsibilities:

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Job Requirements:

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Comfortable debugging distributed systems under load.
• Bias toward shipping and learning from production behaviour.

Tech Stack:

• Python
• Node.js
• Pytorch
• OpenAI / Anthropic / open-source LLMs
• SQL & noSQL
• Kubernetes
• Docker