Senior AI Engineer

Software Engineering, AI Engineering

Full Time

Ho Chi Minh

LARION is a global software outsourcing partner with nearly two decades of experience delivering high-quality software development services to clients worldwide. We help businesses accelerate digital transformation through dedicated development teams, custom software development, AI solutions, and technology consulting.

We are looking for a Senior AI Engineer to design, build, and deploy production-grade AI applications. The role requires strong software engineering fundamentals combined with hands-on experience in LLM applications, RAG, agentic systems, AI evaluation, and production AI systems.

The ideal candidate can take AI solutions from prototype to reliable production systems, make sound technical trade-offs, and contribute to the technical direction of the AI engineering team.

I. What You’ll Do

• Design and develop production-grade LLM-powered applications and AI services.
• Build and optimize RAG and data-grounding solutions, including vector search, hybrid retrieval, reranking, knowledge graphs, and structured data retrieval.
• Design and implement agentic systems and workflows, including tool calling, multi-step reasoning, memory, context management, and agent orchestration.
• Develop evaluation frameworks and regression testing for AI systems, using deterministic evaluations, LLM-as-a-judge, and human-in-the-loop approaches where appropriate.
• Analyze model outputs, traces, and failure cases to drive evaluation-driven development and continuous improvement.
• Design AI systems for production reliability, scalability, security, observability, cost, and latency.
• Implement monitoring and observability for AI applications, including model performance, latency, cost, failures, and potential security risks.
• Select and evaluate appropriate LLM/model architectures and AI techniques based on business and technical requirements.
• Apply machine learning and deep learning fundamentals when developing or integrating AI/ML solutions.
• Collaborate with Product, Data, Software Engineering, and other stakeholders to translate business requirements into scalable AI solutions.
• Provide technical guidance and mentorship to other engineers and contribute to engineering standards and best practices.

II. Job Qualifications

1. Must-have

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field,
• 6+ years of professional software engineering / AI engineering experience, with significant hands-on experience building AI-powered applications.
• Strong proficiency in Python and solid software engineering fundamentals, including system design, API development, testing, debugging, and design patterns.
• Strong hands-on experience with LLMs and Generative AI applications.
• Practical experience with RAG, embeddings, vector databases, information retrieval, and data grounding techniques.
• Experience designing and implementing agentic workflows or AI agents.
• Experience with at least one major AI/LLM framework such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, or equivalent.
• Understanding of LLM fundamentals, including context windows, tokenization, sampling parameters, model selection, tool calling, and model limitations.
• Experience building AI evaluation and testing processes, including error analysis and regression testing.
• Experience deploying and operating AI applications in production environments.
• Good understanding of cloud, containers, CI/CD, monitoring, and observability.
• Strong understanding of databases and data processing, including experience with SQL and/or NoSQL databases.
• Good understanding of machine learning fundamentals, including model evaluation, bias/variance, data quality, and error analysis.
• Strong problem-solving and technical communication skills.
• Ability to produce clear technical documentation (architecture, runbooks, handover documents) and communicate effectively in English.

2. Nice-to-have

• Experience with multi-agent systems, MCP, tool-use, or computer-use agents.
• Experience with knowledge graphs, semantic layers, or hybrid retrieval.
• Experience with multimodal AI, including vision, speech, or document intelligence.
• Experience with fine-tuning, model optimization, quantization, distillation, or self-hosted LLMs.
• Experience with AI security, including prompt injection, data leakage/exfiltration, guardrails, and AI governance.
• Experience with MLOps / LLMOps and production monitoring.
• Experience optimizing AI systems for cost and latency at scale.
• Experience with Kubernetes and cloud platforms such as AWS, Azure, or GCP.
• Experience working in enterprise or regulated environments

III. Why You’ll Love Working Here

1. Workplace

• Work with international clients across diverse industries while contributing to cutting-edge software and AI transformation projects.
• Expand your expertise in B2B technology marketing, demand generation, AI-powered marketing, and global business development.
• Join an organization embracing AI Transformation and continuous innovation to create meaningful business impact.

2. Benefits Comprise

• Competitive compensation: 13th-month salary and performance bonuses.

• Comprehensive healthcare coverage, including accident insurance.

• Generous allowances: lunch, marriage, newborn, bereavement, and more.

• Fully equipped pantry for a comfortable lunchtime experience.

• Diverse sports and social activities: Yoga, football, badminton, tech clubs, charity,

  etc.

• Annual company trip and team-building events.

• Recognition awards: Quarterly, annual, individual, team, and long-term service

  honors.

• Advanced English and soft skills training for career growth.

• Engaging monthly events: Happy gatherings, mini-games, team birthday

  celebrations, year-end party, and more.

• Exclusive company support funds for personal loans (home, vehicle, tuition, etc.).

• Full provision of working equipment and tools required for your role.

IV. Additional Information

• Location: QTSC1 Building, Quang Trung Software City, Trung My Tay Ward, (District 12), Ho Chi Minh City
• Working Hours: Monday to Friday: 08:30 AM – 06:00 PM (with a 1.5-hour lunch break).