Algorithm Expert, Financial Foundation LLM

Job Responsibilities:

1、Foundation Model Pre-training : Design and implement the pre-training pipeline for financial behavior sequence foundation models, including pre-training objective selection (CLM/MLM/Hybrid), Tokenization architecture experimentation (Flat/3D-Transformer/KVT), and scaling experiments.

2、Multi-source Sequence Modeling : Build a unified sequence representation for behavioral data across multiple domains (payments, ride-hailing, food delivery, credit); design and validate the impact of data-source mixing ratios on model performance. Multi-entity and Multi-scale Fusion: Design an Account-Card dual-dimension sequence modeling scheme, along with a cross-temporal-scale fusion architecture bridging micro-level behaviors (millisecond-granularity event tracking) and macro-level behaviors (day/week-level transactions).

3、Ablation Studies and Evaluation Framework : Build a systematic ablation experiment framework; design a freeze-backbone + linear head evaluation pipeline to drive architecture decisions.

4、Production Deployment : Integrate pre-trained representations into downstream risk-control scenarios (stolen-card detection, credit scoring, etc.); design a Blending Module and complete SFT fine-tuning and online deployment.

Qualifications:

1. Must Have:

(1) Master's degree or above in Computer Science, Mathematics, Statistics, or a related field.

(2) 3+ years of deep learning algorithm R&D experience, with hands-on experience building a pre-trained model from scratch and completing the full training pipeline.

(3) Proficiency in Transformer architectures and variants (GPT/BERT/FT-Transformer/MoE), with practical sequence modeling experience.

(4) Familiar with at least one mainstream deep learning framework (PyTorch preferred); experience with distributed training (multi-GPU / multi-node).

(5) Solid experimental design skills: ability to independently conduct ablation studies and scaling-law experiments and draw reliable conclusions.

(6) Strong engineering implementation skills; able to iterate efficiently on model code and training pipelines.

2. Nice to Have:

(1) Modeling experience in financial risk control / anti-fraud / credit scoring.

(2) Publications on Foundation Models / Self-Supervised Learning (NeurIPS/ICML/ICLR/KDD/WWW, etc.).

(3) Familiarity with Contrastive Learning, ELECTRA, cross-modal fusion, and related techniques.

(4) Experience with time-series / event-sequence modeling (e.g., TimeMixer, TrajGPT).

(5) Experience with graph neural networks or graph-based anomaly detection.