Senior AI & Data Engineering Consultant

Senior AI & Data Engineering Consultant

Location: Irving, TX – Hybrid (3 days onsite) / Chicago, IL

Duration: Long Term Contract

Job Summary

We are seeking a Senior AI & Data Engineering Consultant to design and implement AI-powered Contract & Invoice Extraction solutions using Databricks, Azure OpenAI, OCR, RAG, and Agentic AI frameworks . The consultant will build scalable data pipelines, intelligent document processing solutions, AI agents, and enterprise workflow automation while working closely with business and technical stakeholders.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks, Apache Spark/PySpark, SQL, and Python.
• Build data ingestion frameworks for structured and unstructured documents .
• Design Bronze, Silver, and Gold medallion architecture for document-processing workflows.
• Implement data quality, reconciliation, validation, metadata management, and lineage frameworks.
• Develop Intelligent Document Processing (IDP) solutions using LLMs and GenAI.
• Build AI agents for:
• Contract clause extraction
• Invoice validation
• Payment-term identification
• Business-rule evaluation
• Exception handling and workflow automation
• Design and implement RAG architectures and multi-agent workflows.
• Use frameworks such as Microsoft Agentic Framework, LangChain, LangGraph, CrewAI, or Semantic Kernel .
• Develop prompt engineering, model evaluation, and human-in-the-loop review frameworks.
• Integrate OCR and Document Intelligence platforms such as Azure AI Document Intelligence, AWS Textract, Google Document AI, or ABBYY .
• Extract and validate vendor information, invoice details, PO details, payment schedules, contract clauses, and pricing schedules.
• Integrate AI-assisted validation techniques to improve document extraction accuracy.
• Develop REST APIs and integrate AI/data services with enterprise applications.
• Work with business SMEs and invoicing teams to conduct requirements workshops and define technical solutions.
• Present solution architecture, technical designs, and implementation progress to stakeholders.

Required Skills

• 8+ years of experience in Data Engineering, AI Engineering, or related technology roles.
• Strong Databricks, Apache Spark/PySpark, SQL, and Python experience.
• Strong Azure Data Engineering experience.
• Hands-on experience with GenAI/LLMs and Azure OpenAI .
• Experience building RAG-based applications and Agentic AI solutions .
• Experience with LangChain, LangGraph, CrewAI, Semantic Kernel, or similar frameworks .
• Strong experience with OCR/Document Intelligence and intelligent document processing.
• Experience with data modeling, ETL/ELT, REST APIs, and cloud platforms .
• Understanding of vector databases and enterprise AI architectures.
• Strong communication and stakeholder-management skills.

Preferred Skills

• Contract Lifecycle Management (CLM) domain experience.
• Accounts Payable / Invoice Processing experience.
• Knowledge Graph integration experience.
• Healthcare or Financial Services domain experience.
• Experience with Azure, AWS, or GCP .
• Technical certifications across relevant AI, cloud, or data technologies.