Big Data Engineer

About the role

Design, model, and implement the enterprise data warehouse (EDW); drive data governance and data quality initiatives, unify metric standards, and enable metric automation with monitoring and alerting. Build and develop the BI system, data visualization, and reporting framework to support self-service analytics, decision dashboards, and data-driven operations. Combine LLMs / AI agents to build AI-driven data analysis capabilities, delivering scenarios such as data Q&A, anomaly detection, and intelligent analysis. Own big data ETL development and data integration, connecting the full data pipeline across big data and AI services (LLM / RAG / vector databases). Optimize data warehouse and compute task performance, ensure stability, and manage costs; resolve production-critical technical challenges. Track the convergence of big data and AI technologies, and work with the team to deliver integrated Data + AI + BI solutions that improve development and analytical efficiency.

Key responsibilities

• Design, model, and implement the enterprise data warehouse (EDW); drive data governance and data quality initiatives, unify metric standards, and enable metric automation with monitoring and alerting
• Build and develop the BI system, data visualization, and reporting framework to support self-service analytics, decision dashboards, and data-driven operations
• Combine LLMs / AI agents to build AI-driven data analysis capabilities, delivering scenarios such as data Q&A, anomaly detection, and intelligent analysis
• Own big data ETL development and data integration, connecting the full data pipeline across big data and AI services (LLM / RAG / vector databases)
• Optimize data warehouse and compute task performance, ensure stability, and manage costs; resolve production-critical technical challenges
• Track the convergence of big data and AI technologies, and work with the team to deliver integrated Data + AI + BI solutions that improve development and analytical efficiency

About you

• Bachelor's degree or above in Computer Science, Big Data, Statistics, or a related field
• 3–5 years of big data development experience, with hands-on experience in 0-to-1 data warehouse construction, metrics framework development, and BI reporting
• Systematic thinking and strong data modeling capabilities; sensitive to AI + data technologies; self-driven and skilled at cross-team collaboration
• Proficient in the big data stack (Spark / Flink / Hive / Kafka / ClickHouse), with solid experience in offline and real-time data processing
• Strong command of data warehouse layered modeling, dimensional modeling, data governance, metadata, and data quality management
• Proficient in metric design and metric calculation development; experience in BI system development is a plus
• Data visualization expertise, with the ability to build reporting and self-service analytics platforms
• Understanding of LLM / RAG / agent principles, able to combine AI for data analysis and metric-driven applications
• Proficient in relational databases such as MySQL; familiar with vector databases; experienced with Docker / K8s and job scheduling tools
• Proficient in at least one of Java / Scala / Python, with system design and architecture optimization capabilities