Java Architect – AI Platforms & LLM Integration

Job Title: Java Architect – AI Platforms & LLM Integration Job Type: 12–24 Month Project, Contract (C2C / W2 / 1099) *Location: New York, NY (Hybrid – 2-3 Days Onsite per Week)* Job Description We are seeking a seasoned Java Architect with strong experience in building scalable enterprise applications and integrating AI platform capabilities . The ideal candidate will have deep understanding of AI toolchains, LLM-based frameworks (LangChain, Agentic systems) , and enterprise middleware like MCP (Multi-Channel Platform) and A2A (Application-to-Application) integration .

You will drive the design and architecture of intelligent enterprise applications that leverage Java, cloud services, and generative AI models , ensuring performance, security, and extensibility.

Key Responsibilities

• Architect and design enterprise-grade Java applications with integration of AI/ML components.
• Develop AI-enhanced workflows using LangChain, Agentic frameworks, and other LLM orchestration tools.
• Collaborate with data science and ML teams to operationalize LLMs in production.
• Integrate systems across platforms using MCP, A2A, RESTful APIs, and messaging queues.
• Define architectural patterns for prompt chaining, agent workflows, and model routing.
• Ensure system performance, scalability, and security across distributed environments.
• Provide guidance to development teams and perform code/architecture reviews.
• Stay current with advancements in AI/LLM infrastructure and integration frameworks.

Required Qualifications

• 14+ years of experience in Java/J2EE technologies, Spring Boot, REST APIs, Microservices.
• Experience designing scalable systems in cloud environments (AWS/GCP/Azure).
• Hands-on experience with LLM frameworks such as LangChain, LLamaIndex, Agentic workflows, or RAG pipelines.
• Strong understanding of MCP and A2A frameworks for enterprise communication and middleware.
• Experience with containerization and orchestration (Docker, Kubernetes).
• Solid understanding of security, identity management (OAuth2, SSO), and data compliance.
• Excellent problem-solving, communication, and leadership skills.

Preferred Qualifications

• Experience with LLM API integrations (OpenAI, Anthropic, etc.)
• Familiarity with vector databases (e.g., FAISS, Pinecone, Chroma).
• Experience with streaming platforms like Kafka.
• Knowledge of DevOps practices, CI/CD pipelines.

Prior experience mentoring or leading distributed engineering teams