Lead Azure DevOps Engineer

We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities

• Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
• Integrate models and providers into gateway solutions to support enterprise-scale operations
• Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
• Establish observability and resilience mechanisms to maintain production stability
• Implement LLM routing and broker logic to optimize model performance and reliability
• Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
• Take ownership of gateway implementation projects and deliver functional solutions rapidly
• Collaborate with cross-functional teams to align gateway operations with organizational security standards
• Monitor and troubleshoot production systems to ensure continuous availability

Requirements

• 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
• Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
• Proficiency in LiteLLM and other LLM gateway platforms
• Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
• Understanding of LLM routing, broker logic, and token/rate control mechanisms
• Skills in observability, resilience engineering, and production system operations
• Capability to take ownership and deliver functional gateway implementations rapidly
• English proficiency at B2 level or higher

We offer

• We connect like-minded people:

• Delivering innovative solutions to industry leaders, making a global impact

• Enjoyable working environment, whether it is the vibrant office or the comfort of your own home

• Opportunity to work abroad for up to two months per year

• Relocation opportunities within our offices in 55+ countries

• Corporate and social events

• We invest in your growth:

• Leadership development, career advising, soft skills and well-being programs

• Certifications, including GCP, Azure and AWS

• Unlimited access to EPAM's internal learning database

• Free English classes with certified teachers

• We cover it all:

• Monetary bonuses for engaging in the referral program

• Medical & family care package

• Six trust days per year (sick leave without a medical certificate)

• Coverage of psychology sessions of your choice

• Discounts for fitness clubs and sports programs

• Benefits package (sports activities, a variety of stores and services)

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

Experience the freedom of remote work from anywhere in Kyrgyzstan, whether it's the comfort of your home or our modern office in Bishkek.