AI,ML CUDA Engineer

Location

Flexible, USA

Company QFocus Technologies LLC

Domain

Embedded software

Description We are seeking an experienced Embedded AI Engineer to join our team in validating PyTorch-based Large Language Models (LLMs) using CUDA SDK APIs. The successful candidate will be responsible for debugging, extending and replacing the underlying CUDA code to ensure seamless functionality on our company-specific AI processors.

Key Responsibilities

• Validate PyTorch-based LLMs on company-specific AI processors using CUDA SDK APIs
• Debug and troubleshoot issues related to CUDA code integration with PyTorch models
• Extend and modify CUDA code to optimize performance on company-specific AI processors
• Replace existing CUDA code with custom implementations to meet specific requirements
• Collaborate with cross-functional teams to ensure successful integration of LLMs with company-specific AI processors
• Develop and maintain validation frameworks and tools for PyTorch-based LLMs
• Analyze and optimize the performance of LLMs on company-specific AI processors

Requirements

• Bachelor's or Master's degree in Computer Science, Electrical Engineering or related fields

• Strong experience with CUDA programming and PyTorch framework

• In-depth knowledge of deep learning models, particularly Large Language Models (LLMs)

• Proficiency in C++ and Python programming languages

• Experience with debugging and troubleshooting complex software issues

• Excellent problem-solving skills and attention to detail

• Strong communication and collaboration skills Nice to Have

• Experience with AI processor architecture and design

• Knowledge of other deep learning frameworks, such as TensorFlow QFocus Technologies LLC is an Equal Employment Opportunity employer.