Principal AI Architect

Position : AI Principal Architect

Location: Santa Clara, CA or New Jersey – Hybrid

Employment: Full-Time Permanent (Direct Hire)

Experience: 15+ Years

Mandatory Skills

Agentic AI | Generative AI | Large Language Models (LLMs) | Multi-Agent Architecture | RAG | Azure OpenAI | Vertex AI | AWS Bedrock | Azure | AWS | GCP | AI Architecture | Kubernetes | LangChain | LlamaIndex | Semantic Kernel

Job Description

We are seeking an experienced AI Principal Architect to define enterprise AI strategy and lead the design of scalable, secure, and production-ready Generative AI and Agentic AI solutions. This role combines deep technical expertise with executive-level advisory, driving AI architecture, governance, and enterprise adoption across hybrid cloud environments.

Key Responsibilities

• Define architecture and best practices for Agentic AI , Multi-Agent Systems , and enterprise AI platforms.
• Design scalable RAG (Retrieval-Augmented Generation) and Cache-Augmented Generation (CAG) architectures, including vector search, embeddings, retrieval strategies, and evaluation frameworks.
• Architect AI memory systems using vector databases, knowledge graphs, and session memory.
• Design secure AI solutions across Azure, AWS, and GCP , leveraging platforms such as Azure OpenAI, Vertex AI, and AWS Bedrock .
• Establish standards for GenAIOps , CI/CD, Infrastructure as Code (IaC), observability, monitoring, and AI performance metrics.
• Define enterprise AI governance, including NIST AI RMF, ISO 42001 , prompt security, PII protection, hallucination mitigation, and Human-in-the-Loop (HITL) controls.
• Architect integrations with enterprise platforms including Microsoft Entra ID, Teams, Dynamics 365, Salesforce, ERP systems, and Kubernetes .
• Lead executive workshops, advise senior stakeholders on AI strategy, and translate business objectives into scalable AI solutions.
• Mentor architects and engineering teams while contributing to AI standards, best practices, and technology roadmaps.
• Represent the organization through industry events, technical publications, and AI thought leadership.

Required Skills

• 12+ years of technical leadership in software engineering, enterprise architecture, or cloud architecture.
• Strong expertise in Azure, AWS, or GCP , with hands-on experience across multiple cloud platforms.
• Experience designing enterprise GenAI and LLM solutions using Azure OpenAI, Vertex AI, or AWS Bedrock .
• Hands-on expertise in RAG architectures, LLM orchestration, and AI solution design .
• Experience with instruction tuning or fine-tuning of Large Language Models.
• Strong executive communication and stakeholder management skills.

Preferred Skills

• Multi-Agent AI architecture and orchestration.
• LangChain, LlamaIndex, Semantic Kernel , or similar AI frameworks.
• GenAIOps, AI FinOps, model routing, and AI governance.
• AI security, compliance, and responsible AI frameworks.
• Professional cloud certifications (Azure, AWS, or GCP).
• Conference speaking, technical publications, patents, or open-source contributions.