Al Engineer, Large Language Model

Department Engineering and Technology

LevelExperienced (Individual Contributor)

LocationSingapore

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

About the Team:

Compass is Shopee's globally competitive, ultra-large-scale multilingual foundation model, built with advanced cross-cultural understanding, complex reasoning, and agentic execution capabilities. Leveraging the rich multilingual and multicultural data advantages of global emerging markets — particularly Southeast Asia — the Compass model family has successfully evolved from v1 through v3. We are now pushing the frontiers of foundation model research to build the next-generation base model with more advanced architectures and superior capabilities, establishing a world-leading technology system for multilingual intelligence and Agentic LLM. Through deep research into algorithms and data strategies, we aim to develop principled scaling laws to guide model planning, break through training and inference efficiency bottlenecks, and forge a deterministic path from data governance to emergent intelligence.

Job Description:

• Contributions to the research and implementation of pre-training and alignment algorithms include ultra-large-scale multilingual pre-training technology, Mixture-of-Experts model training, Instruction Pretraining, SFT, and RLHF.
• Contribute to the explanation and safety improvement of AI, especially in trustworthy Large language models.
• Follow the frontier technologies and make comparisons about the advanced technologies to apply in business scenarios.
• Conduct experiments to test the performance of different AI models, identifying areas for improvement and exploring new directions for enhancement.
• Work collaboratively in a team environment, applying expertise in statistics, scripting, and relevant programming languages.

Requirements:

• Doctorate degree in Computer Science, Information Technology, Programming & Systems Analysis, or other related disciplines
• Excellent coding skills, data structure and basic algorithm skills, proficiency in Python/Pytorch coding.
• Minimum 1 year of research experience in basic principles and training methods of industry-leading LLM (such as GPT, LLaMA).
• Have research experience in text generation or dialogue systems
• Excellent problem analysis and solving skills, able to deeply solve problems in large model training and application.
• Good communication and collaboration skills, able to explore new technologies with the team and promote technological progress.