AI Software Architect

Job Details Job Description:

The Role and Impact We are seeking a dynamic AI Software Architect to contribute to Intel's cutting-edge AI frameworks software stack. In this role, you will design, develop, and optimize software features for AI frameworks, focusing on inference serving frameworks like PyTorch vLLM and SGLang. You will play a key role in enhancing deep learning inference and training/fine-tuning capabilities, while identifying optimization opportunities to boost workload performance across software and hardware layers.

Business Group The position is part of Intel's Data Center Group (DCG), a global leader in driving innovation across data center platforms. The AI Software Architects team focuses on advancing AI software solutions to enable Intel's AI accelerators and next-generation GPUs, supporting Intel's mission to shape the future of technology for data-driven industries.

Key Responsibilities

• Design and develop software features for AI frameworks, including hardware-agnostic and hardware-aware capabilities.
• Architect and analyze state-of-the-art features across frameworks to drive development throughout the software stack.
• Enhance and extend deep learning training and inference capabilities within Intel's AI frameworks software stack.
• Optimize software stack performance for deep learning workloads on GPUs and AI accelerators.
• Participate in discussions and development within open-source communities, contributing to upstream adoption and integration.
• Debug complex issues in multi-layered software systems and ensure seamless integration within large open-source frameworks.
• Conduct performance analysis using open-source and proprietary profilers to optimize code efficiency on host and accelerator platforms.
• Build technology demonstrators and proof-of-concepts for new features in the Intel AI Software Stack for current and upcoming GPUs

Qualifications Minimum Qualifications

• Bachelor's degree in Computer Science, Electrical and Computer Engineering, or related fields with 6+ years of industry experience; or Master's degree with 4+ years; or PhD with 2+ years.
• Proficiency in Python for developing complex software implementations.
• Intermediate expertise in advanced C++ programming (C++14/17), including parallel programming.
• Hands-on experience with frameworks such as PyTorch, vLLM, and SGLang.
• In-depth knowledge of Large Language Models (LLMs).
• Strong understanding of computer architecture and hardware-software optimization techniques.
• Proven ability to debug complex issues across multi-layered software systems.

Preferred Qualifications

• Practical experience with deep learning models for image and video generation.
• Expertise in developing and integrating kernels (e.g., GEMM, Convolution, Flash Attention) using frameworks like CUTLASS or Triton.
• Knowledge of compiler algorithms for heterogeneous systems and Fuser optimizations.
• Effective communication skills and experience collaborating with cross-geo teams.

Join us to drive innovation in AI software solutions and shape the future of data-driven technologies with Intel's cutting-edge platforms.

Job Type Experienced Hire

Shift Shift 1 (India)

Primary Location:

India, Bangalore

Additional Locations:

Posting Statement All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust

N/A

Work Model for this Role This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. * Job posting details (such as work model, location or time type) are subject to change.

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.