Backend Engineer, AI (Agent System/ Worldwide)

About Company

Our client is one of Southeast Asia’s largest tech aggregators, building the world’s next generation of AI-native productivity applications.

Job Description

• Own the inference and orchestration layer that powers every AI interaction in the product.
• Build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.
• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.
• Ensure backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
• Ensure APIs are stable, clear, and support seamless integration with frontend and ML systems.
• Ensure production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
• Other ad hoc assignments/projects assigned by the company

Job Requirements

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Comfortable debugging distributed systems under load.
• Bias toward shipping and learning from production behavior.
• Tech stack: Python, NodeJs, Pytorch, OpenAI / Anthropic / open-source LLMs, SQl & noSQL, Kubernetes, Docker

Compensation

• Remote job/ Fully Working from Home (WFH)
• Working hours: Office hours (depending to job location)