AI Quality Engineer

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring an AI Quality Engineer in Kuala Lumpur, Malaysia!

Join us in building a next-generation AI Virtual Companion for Operation Planning & Optimization. Powered by Large Language Models (LLMs) and agentic AI, you'll help create intelligent systems that can reason, retrieve information, and act autonomously.

Role Responsibilities & Job Description:

• Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI’s boundaries and responses.
• LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention.
• Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale.
• Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks.
• Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability.
• Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation.

Requirements & Qualifications:

• Bachelor’s degree or above, with 2-5 years in software development and relevant experience specifically within the AI/ML development landscape.
• AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows.
• Programming: Proficiency in Python.
• API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.

What's in it for you?

• You will be working at the intersection of Software Engineering, Data Science, and Ethics. You will play a pivotal role in defining what "quality" means for the next generation of Virtual Companions, helping us build AI that users can trust and enjoy.
• Impact: Directly shape a product that will be used by global supply chain leaders.
• Innovation: Work at the intersection of Generative AI, agentic systems, and real world optimization.
• Culture: Collaborative, ethically driven, and inclusive environment.
• Growth: Dedicated learning budget, hands on exposure to real world supply chain challenges, clear career pathways

Inclusion statement

As a game-changer in sustainable technology and innovation, Dassault Systèmes is striving to build more inclusive and diverse teams across the globe. We believe that our people are our number one asset and we want all employees to feel empowered to bring their whole selves to work every day. It is our goal that our people feel a sense of pride and a passion for belonging. As a company leading change, it’s our responsibility to foster opportunities for all people to participate in a harmonized Workforce of the Future.