Performance Modeling Engineer

• Develop comprehensive performance models and projections for Sohu’s transformer-specific architecture across varying workloads and configurations
• Profile and analyze deep learning workloads on Sohu to identify micro-architectural bottlenecks and influence optimization opportunities
• Drive hardware/software co-optimization by identifying where architectural features can unlock performance improvements
• Run regressions and validate performance models against real systems and silicon
• Inform next-generation architectural decisions by pathfinding across system and silicon options during design, proof-of-concept, and architecting phases

Benefits

• Competitive Salary and Equity - We offer a competitive salary and equity package that aligns with industry standards
• Benefits - Your wellbeing is important to us. We offer unlimited PTO, life insurance, and a 401(k)
• Full Insurance Coverage - Our insurance includes full medical, dental, and vision with 100% of premium covered- Solid software engineering fundamentals with an eye toward auditability and maintainability
• Experience profiling and analyzing deep learning workloads on hardware accelerators (GPUs, TPUs, ASICs, FPGAs, or others)
• Strong performance modeling and analysis skills with experience building analytical-based or simulation-based performance models
• Solid understanding of computer architecture and micro-architecture, particularly for accelerators
• Published research in computer architecture, ML systems, or hardware acceleration
• Familiarity with transformer model architectures and inference serving optimizations
• Experience with architecture simulators and performance modeling tools (gem5, trace-driven simulators, custom models)
• Deep knowledge of GPU architectures and/or programming models like CUDA
• Exposure to ASIC, FPGA, or CGRA-based accelerator development and hardware/software co-design principles
• Experience mapping models to multi-chip inference systems