Data Engineer Lead

Job Title: Data Engineer Lead
Experience- 4 years of atleast relevant experience in team handling experience and 2 to 3 years normal as data engineer overall 6 to 7 years exp candidate they want.

Reports To: Data Platform Manager

Job Summary

We are looking for a Data Warehouse Engineering Lead to develop and deploy data products through our Azure Analytics Platform. You will work closely with the DWH team, Data Architect and senior stakeholders across the business. It’s an exciting time to join us as we’re delivering our Data Strategy to support the transformation of our business through innovation & technology.

Main Duties & Responsibilities

The role core duties include but are not limited to:

• Provide expertise and guidance to your direct reports ensuring that the team can deliver a vital Data Service to the business.
• Ensure our Data Governance principals are implemented and adhered to and to be an advocate of best practice in Data Product delivery.
• Build and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
• Work with key stakeholders including Senior management, Developers, Data, and Project teams to assist with data-related technical issues and support their data infrastructure needs.
• Develop and maintain a group-wide Data Estate incorporating a Data Lake and Data Warehouse using best practice warehouse methodologies.
• Define data integration and ingestion strategies to ensure smooth and efficient data flow from various sources into the data lake and warehouse.
• Develop data modelling and schema design to support efficient data storage, retrieval, and analysis.

Key Skills
Essential

Cloud & Data Engineering Platforms:

Azure Data Factory, Azure Databricks (including Unity Catalog & Notebooks), Azure Functions, Azure Apps, Azure DevOps Pipelines

Data Transformation & Modelling:

dbt (Data Build Tool) for scalable modelling and transformation in cloud data platforms

Programming & Query Languages:

PySpark, PySQL, T-SQL, MS SQL, Stored Procedures

ETL/ELT & Data Integration:

MS SSIS, WebHooks, RESTful APIs, automated pipelines for batch and streaming data

Data Architecture & Quality:

Data Modelling, Data Analysis, Data Quality frameworks, dimensional modelling

Leadership & Communication:

Proven experience in team management, mentoring cross-training initiatives, and coordinating with diverse business stakeholders

Governance & Compliance:

Data Privacy (GDPR, CCPA), Metadata management, data discovery, data security (RBAC, CLS, RLS)

Certifications:

Azure Administrator [AZ-104]

Fabric Data Engineer [DP-700]

Fabric Analytics Engineer [DP-600]

Azure DevOps Engineer [AZ-400]

Interested Candidates can reach out - [email protected] / 9482744952

Pay: ₹1,000,000.00 - ₹1,500,000.00 per year

Work Location: In person