AI Engineer Copilot Studio & Azure AI Foundry

Position: AI Engineer Copilot Studio & Azure AI Foundry

Location: Pune
Experience: 3+ Years
Notice Period: 0–30 Days

Role Overview

As an AI Engineer, you will design, build, and operate intelligent agentic workflows and agents using Microsoft Copilot Studio and Azure AI Foundry. You will integrate LLMs with enterprise data, implement secure and reliable AI agents, and continuously improve quality through evaluation, tracing, and structured experimentation.

Key Responsibilities

1. Agent & Workflow Engineering

• Design, implement, and ship conversational and agent workflows.
• Implement RAG with vector/hybrid retrieval and integrate enterprise data sources.
• Use tool calling/actions and publish agents to chat and web with proper authentication.
• Apply software engineering best practices.

2. Prompting, Quality & LLMOps

• Design prompts, system messages, and agent behaviors for robustness and reliability.
• Run structured Prompt flow experiments and evaluations.
• Perform tracing, A/B testing, and error analysis.

3. Data, Integrations & RAG Pipelines

• Connect agents to enterprise sources such as SharePoint, Microsoft Graph, and Azure Blob.
• Build ingestion, chunking, and embedding pipelines.
• Use Azure AI Search for vector/hybrid retrieval when required.
• Develop clean, versioned API integrations.

4. Security, Compliance & Governance

• Enforce least-privilege access, secrets hygiene, and managed identities.
• Apply content-safety guardrails, prompt-injection resilience, and input/output filtering.
• Follow environment strategies and DLP policies aligned with enterprise governance.

5. Operations, Cost & Observability

• Monitor runtime using logs, metrics, and distributed tracing.
• Maintain dashboards and define and track KPIs such as cost per successful task and task-success rate.
• Apply resilience patterns including retries, timeouts, circuit breakers, and rate limits.

Required Skills

• Strong hands-on AI experience is mandatory.
• Hands-on experience with Microsoft Copilot Studio and Azure AI Foundry.
• Experience with agent patterns, Prompt flow, evaluation, and tracing.
• Strong RAG expertise, including index design, embeddings, and hybrid/vector retrieval.
• Experience working with enterprise connectors; Custom Connectors are a plus.
• Strong Python programming skills.
• C# or JavaScript is a plus.
• Experience with APIs, data modeling, and integrations.
• Experience with low-code ALM, including Solutions and Pipelines.
• Knowledge of DLP guardrails.
• Strong English communication skills.

Preferred Skills

• Experience shipping production agents across chat/web with measurable impact.
• Experience with A/B testing and performance evaluation.
• CI/CD practices and Infrastructure as Code using Terraform or Bicep.
• Experience with Semantic Kernel for plugin orchestration and memory/vector connectors.
• Experience with Prompt flow, including evaluations, tracing, and experiments.

Common AI Tools & Frameworks

• Azure AI Foundry SDKs — Python/JavaScript/C#
• Azure AI Search — Vector, Hybrid, Semantic Search
• Azure Monitor & Application Insights
• Power Platform ALM
• GitHub Actions / Azure DevOps Pipelines

Soft Skills & Ways of Working

• Strong communication and collaboration abilities.
• Problem-solving mindset.
• Ability to work independently and in cross-functional teams.
• Attention to detail and commitment to quality.
• Integrity and high ethical standards.
• Strong follow-up skills and disciplined approach.
• Good team player with the ability to work with multicultural users and IT counterparts across the globe.
• Clear communication of complex AI behavior to stakeholders.
• Ability to translate business use cases into technical agent designs.
• Proactive documentation, knowledge sharing, and enablement.
• Comfortable with iterative learning, experimentation, and rapid feedback cycles.
• Ownership mentality across design, deployment, and monitoring.