Senior System Software Engineer, Agentic Retrieval

For our client, we are seeking a Senior System Software Engineer, Agentic Retrieval to join the team of a leader in the Telecommunications & Hardware space.

This role will help shape GPU-accelerated software that supports advanced generative AI and LLM workflows at scale. You will work closely with ML researchers and cross-functional engineering partners to build performant data processing and retrieval systems. The position blends systems engineering, optimization, and production readiness to improve reliability, speed, and the end-user experience across AI applications.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $184,000 – $356,500 annually

Responsibilities

• Develop and optimize Rust-based data processing frameworks for large datasets in GPU-accelerated environments
• Lead development and optimization of agentic retrieval pipelines for improved performance
• Collaborate with LLM and ML researchers to create GPU-accelerated data preparation pipelines
• Implement benchmarking and optimization of algorithms in Python for LLM applications
• Build and evaluate proof-of-concepts, developing roadmaps for production-level tools
• Create integrated systems for a unified user experience across applications
• Maintain continuous delivery pipelines for faster and safer production changes
• Provide peer reviews and contribute to the adoption of new technologies and standards

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience
• 6+ years of experience in a similar or related role
• Experience delivering software in a cloud context and managing cloud infrastructure
• Knowledge of MLOps technologies such as Docker Compose, containers, and Kubernetes
• In-depth understanding of NLP, LLM, VLM, Generative AI, and agentic retrieval workflows
• Self-starter with a passion for growth and continuous learning
• Outstanding communication skills with the ability to simplify complex topics
• Ability to work effectively with multi-functional teams across organizational boundaries

Benefits

• Opportunity to work on cutting-edge technology in Generative AI and LLM
• Collaborative environment with diverse teams and experts
• Focus on continuous learning and professional growth
• Access to innovative hardware and software platforms
• Impactful work that enhances user experiences for millions

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.