Artificial Intelligence Engineer

We are looking for an experienced AI Engineer with a strong foundation in backend development and Generative AI to build, deploy, and scale intelligent, production-ready applications. This role involves developing AI-powered services, integrating Large Language Models (LLMs) into backend systems, establishing evaluation and quality frameworks, and ensuring the reliability and performance of AI solutions in production environments.

The ideal candidate combines solid software engineering principles with hands-on experience delivering ML/LLM-powered capabilities, building scalable APIs and microservices, and monitoring AI system performance throughout the development lifecycle.

Key Responsibilities

• Backend Engineering: Design, develop, and maintain scalable backend services, APIs, and microservices that power AI-driven applications.
• GenAI Integration: Integrate LLMs and machine learning models into production systems, ensuring efficient inference, reliability, and scalability.
• End-to-End AI Development: Take ownership of AI features from technical design and implementation through deployment, evaluation, and ongoing optimization.
• LLM Harness & Quality Frameworks: Develop and improve the supporting infrastructure, testing mechanisms, and evaluation frameworks required to validate AI system behavior and output quality.
• Production Monitoring: Implement monitoring, observability, and performance evaluation mechanisms to track system health, model quality, latency, and reliability.
• System Reliability: Identify, troubleshoot, and resolve complex issues across model-serving layers, backend services, APIs, and supporting infrastructure.
• Real-Time Infrastructure: Build and optimize real-time serving systems and distributed services that support responsive, production-grade AI applications.
• Technical Design: Participate in architecture discussions, system design reviews, and code reviews to maintain high engineering standards.
• Cross-Functional Collaboration: Work closely with product managers, ML engineers, and other stakeholders to translate business requirements into practical technical solutions.
• Continuous Improvement: Identify opportunities to improve system performance, engineering efficiency, scalability, and the overall quality of AI-powered products.

Required Qualifications

• 4+ years of professional experience in backend software engineering using Python, Go, Java, or similar programming languages.
• 4+ years of hands-on experience working with ML/LLM integration in production systems.
• Demonstrated experience developing, deploying, or maintaining backend services, APIs, and microservices.
• Strong understanding of distributed systems, high-performance applications, and scalable software architecture.
• Experience integrating AI/ML models into production environments and supporting model inference or serving workflows.
• Familiarity with model evaluation methodologies, performance metrics, and techniques for assessing AI system quality.
• Knowledge of cloud infrastructure, production observability, logging, monitoring, and troubleshooting practices.
• Strong problem-solving skills, with the ability to investigate complex technical issues across interconnected systems.
• Ability to work independently in ambiguous environments and adapt to evolving technical requirements.
• Excellent communication skills and the ability to collaborate effectively across engineering and product teams.

BayOne is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any federal, state, or local protected class.

This job posting represents the general duties and requirements necessary to perform this position and is not an exhaustive statement of all responsibilities, duties, and skills required. Management reserves the right to revise or alter this job description.