Principal Engineer

Hiring: Principal Engineer / FDE – AI Agent Platform

📍 Location: New York, NY

🏢 Work Model: Hybrid – 3 Days Onsite

💼 Employment Type: Full-Time

We are looking for a Principal Engineer / Forward Deployed Engineer (FDE) to build the execution layer powering enterprise AI Agent platforms .

This is a highly hands-on engineering role focused on LLM runtime services, agent orchestration, distributed systems, model routing, tool execution, state management, and production AI infrastructure .

🔥 Key Responsibilities

• Design and build scalable runtime services for long-running, asynchronous AI workloads
• Build AI Agent / Agentic AI execution frameworks
• Develop LLM model routing and abstraction layers across multiple providers
• Implement Function Calling / Tool Calling / Tool Invocation
• Design execution state management, retries, checkpointing and failure recovery
• Build reusable APIs and SDKs for AI workflows
• Develop tracing, telemetry, observability and evaluation capabilities
• Work with Knowledge Graphs and enterprise knowledge systems
• Collaborate with Security, Identity and Platform Engineering teams
• Build secure, reliable, cloud-native AI services at enterprise scale

✅ Required Skills

• Strong Software Engineering & Distributed Systems background
• Production experience with LLMs, AI Agents, Agentic AI, Function Calling or Workflow Orchestration
• Experience with asynchronous systems, queues, state management, retries and failure recovery
• Experience with model APIs, structured outputs, prompt/context management
• Experience with LLM/AI performance optimization
• Strong API / Microservices development experience
• Kubernetes, Docker/Containers, Cloud-native architecture
• Experience with Knowledge Graphs
• Strong production engineering and troubleshooting skills