Artificial Intelligence Architect

AI Architect

Role Title

AI Architect

Experience Level

Twelve Plus Years Overall (Four Plus Years in AI/ML Architecture)

Core Focus

GenAI Architecture & Strategy, Engineering Architecture, MLOps/LLMOps, Customer Engagement, Governance

Role Overview

We are looking for an experienced AI Architect to lead the design and implementation of enterprise-scale AI/GenAI solutions. This role bridges the gap between cutting-edge generative AI capabilities and robust engineering architectures, ensuring our AI systems are scalable, secure, and production-ready.

Key Responsibilities

GenAI Architecture & Strategy

• Define and own the end-to-end architecture for Generative AI solutions including LLM-powered applications, RAG pipelines, agentic workflows, and multi-model orchestration.
• Evaluate, select, and integrate foundation models (commercial and open-source) based on cost, latency, accuracy, and compliance requirements.
• Design prompt engineering frameworks, guardrails, and evaluation strategies for GenAI systems.
• Architect fine-tuning, distillation, and model customization pipelines where needed.
• Stay current with the rapidly evolving GenAI landscape and translate research advancements into practical enterprise solutions.

Engineering Architecture

• Design scalable, resilient, and cost-efficient cloud-native architectures for AI/ML workloads.
• Define reference architectures, design patterns, and technical standards for AI system development across the organization.
• Architect data pipelines, feature stores, vector databases, and model serving infrastructure.
• Ensure non-functional requirements performance, security, observability, disaster recovery — are built into every solution.
• Drive API design, microservices decomposition, and integration patterns for AI-enabled products.

Customer Engagement & Consulting

• Serve as the primary technical advisor for enterprise clients, leading discovery workshops, solution briefings, and architecture deep-dives.
• Translate client business challenges into well-scoped AI/GenAI solution architectures, producing proposals, statements of work, and technical roadmaps.
• Drive pre-sales and proof-of-concept engagements, demonstrating solution value and accelerating client decision-making.
• Gather and synthesize customer feedback to influence product direction and shape reusable consulting accelerators.
• Represent the organization at client executive briefings, industry conferences, and external AI forums.

Leadership & Governance

• Collaborate with product, engineering, data science, and platform teams to align AI architecture with business goals.
• Establish AI governance frameworks covering model lifecycle management, bias/fairness monitoring, and responsible AI practices.
• Conduct architecture reviews, provide technical mentorship, and build internal capability in AI/GenAI.
• Create and maintain architecture decision records (ADRs), technical documentation, and roadmaps.
• Represent the organization in vendor evaluations, technology partnerships, and industry forums.

Required Qualifications & Skills

• Experience: Twelve plus years in software/data engineering with at least 4+ years in AI/ML architecture roles.
• GenAI Expertise: Hands-on experience building production systems with LLMs (GPT, Claude, Gemini, Llama, Mistral, etc.), RAG architectures, vector stores (Pinecone, Weaviate, pg vector), and agentic frameworks (LangChain, LangGraph, CrewAI, or similar).
• Engineering Architecture: Deep knowledge of distributed systems, cloud platforms (AWS/Azure/GCP), containerization (Kubernetes, Docker), and CI/CD for ML (MLOps/LLMOps).
• Data & ML Platforms: Experience with ML platforms (SageMaker, Vertex AI, Databricks), data orchestration (Airflow, Dagster), and streaming systems (Kafka, Flink).
• Programming: Strong proficiency in Python; working knowledge of Java, Go, or TypeScript is a plus.
• System Design: Proven ability to design systems that handle scale, fault tolerance, and low-latency inference.
• Communication: Ability to articulate complex technical concepts to both engineering teams and executive stakeholders.

Preferred Qualifications

• Experience with multi-modal AI systems (text, image, audio, video).
• Familiarity with AI safety, alignment, and responsible AI frameworks.
• Exposure to edge/on-device AI deployment.
• Contributions to open-source AI projects or published research.
• Experience in regulated industries (finance, healthcare, government) with compliance-aware AI deployments.

Indicative Tech Stack

Area

Technologies

Foundation Models

OpenAI GPT, Anthropic Claude, Google Gemini, Meta Llama, Mistral

GenAI Tooling

LangChain, LangGraph, LlamaIndex, Semantic Kernel, Haystack

Vector Databases

Pinecone, Weaviate, Qdrant, pgvector, ChromaDB

ML/MLOps

SageMaker, Vertex AI, MLflow, Kubeflow, Weights & Biases

Cloud & Infra

AWS / Azure / GCP, Kubernetes, Terraform, Docker

Data

Spark, Kafka, Airflow, Snowflake, Delta Lake

Observability

Datadog, Grafana, LangSmith, Arize AI

What You'll Influence

• The GenAI strategy and technical direction of the organization.
• Build vs. buy decisions for AI capabilities.
• Engineering culture around AI-first product development.
• Talent development and hiring standards for AI engineering teams.

We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.