DataOps Lead

Job Overview -

We are looking for a hands-on Lead Engineer with strong expertise in Azure, Data Engineering, and AI/LLM technologies. The role involves working closely with clients, building scalable data platforms, and managing a small team.

Key Responsibilities -

Design and build data pipelines and ETL processes

Work on Databricks and Medallion Architecture

Develop solutions using Python, PySpark, and SQL

Implement Azure-based data solutions

Manage CI/CD pipelines using Azure DevOps and GitHub

Work on AI/GenAI and LLM-based applications

Collaborate with clients to deliver data solutions

Lead and mentor a team of 45 members

Contribute to data and AI architecture design

Mandatory Skills -

Data Engineering (Coding, Data Modeling, Data Understanding, Databricks)

Azure (Strong expertise)

DevOps (Azure DevOps, GitHub, CI/CD pipelines)

Python, PySpark / Spark, SQL

API and ETL development

AI / LLM / LLMOps, Gen AI/Agentic AI

Good to Have -

Understanding of Agentic Applications

Vibe Coding

Code review and optimization skills

Role Expectations -

Hands-on development (Python/PySpark preferred)

Experience with GenAI / LLM applications

Client-facing experience

Team management (45 members)

Exposure to Big Data / AI platform architecture