Al Engineer, Large Language Model

About The Team Compass is Shopee's globally competitive, ultra-large-scale multilingual foundation model, built with advanced cross-cultural understanding, complex reasoning, and agentic execution capabilities. Leveraging the rich multilingual and multicultural data advantages of global emerging markets — particularly Southeast Asia — the Compass model family has successfully evolved from v1 through v3. We are now pushing the frontiers of foundation model research to build the next-generation base model with more advanced architectures and superior capabilities, establishing a world-leading technology system for multilingual intelligence and Agentic LLM. Through deep research into algorithms and data strategies, we aim to develop principled scaling laws to guide model planning, break through training and inference efficiency bottlenecks, and forge a deterministic path from data governance to emergent intelligence.

Job Description

• Contributions to the research and implementation of pre-training and alignment algorithms include ultra-large-scale multilingual pre-training technology, Mixture-of-Experts model training, Instruction Pretraining, SFT, and RLHF.
• Contribute to the explanation and safety improvement of AI, especially in trustworthy Large language models.
• Follow the frontier technologies and make comparisons about the advanced technologies to apply in business scenarios.
• Conduct experiments to test the performance of different AI models, identifying areas for improvement and exploring new directions for enhancement.
• Work collaboratively in a team environment, applying expertise in statistics, scripting, and relevant programming languages.

Requirements

• Doctorate degree in Computer Science, Information Technology, Programming & Systems Analysis, or other related disciplines
• Excellent coding skills, data structure and basic algorithm skills, proficiency in Python/Pytorch coding.
• Minimum 1 year of research experience in basic principles and training methods of industry-leading LLM (such as GPT, LLaMA).
• Have research experience in text generation or dialogue systems
• Excellent problem analysis and solving skills, able to deeply solve problems in large model training and application.
• Good communication and collaboration skills, able to explore new technologies with the team and promote technological progress.