Azure Data Fabric Engineer

Role Summary:

We are seeking a skilled Azure Data Fabric Developer to design, build, and maintain unified data platforms using Microsoft Fabric. In this role, you will operate at the intersection of data engineering, analytics, and cloud architecture, helping the organization unlock actionable insights from large, complex datasets. You will collaborate with data architects, analysts, and business stakeholders to deliver scalable, secure, and high-performance data solutions.

Key Responsibilities:

• Design and develop end-to-end data pipelines using Microsoft Fabric (Data Factory, Dataflows Gen2, Notebooks, Pipelines) and Azure Data Factory (ADF). Build and manage models in the Microsoft Fabric ecosystem.
• Build and manage data models across OneLake and Fabric Workspaces, ensuring well-structured environments, access, and collaboration across teams.
• Develop and optimise complex SQL, PySpark, and DAX queries for large-scale data processing and analytics workloads.
• Integrate Fabric workloads with Azure services including Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Azure Databricks, and Power BI.
• Implement medallion architecture and data modelling best practices, following standard SDLC practices to ensure data quality, consistency, and reliable releases.
• Collaborate with stakeholders to translate business requirements into scalable data solutions and reusable data assets.
• Ensure data governance, lineage tracking, and compliance using Microsoft Purview and Fabric's built-in governance features.
• Monitor, troubleshoot, and performance-tune data workflows, keeping an eye on capacity usage and cost efficiency (FinOps) while ensuring SLAs are met.
• Participate in CI/CD pipeline setup for data workloads using Azure DevOps and Git-based version control.

Skills and qualifications:

• Design and develop end-to-end data pipelines using Microsoft Fabric (Data Factory, Dataflows Gen2, Notebooks, Pipelines); hands-on Azure Data Factory (ADF) experience is mandatory.
• Build and manage data models within the Microsoft Fabric ecosystem, including OneLake and Fabric Workspace setup and management.
• Develop and optimise complex SQL, PySpark, and DAX queries for large-scale data processing and analytics workloads.
• Integrate Fabric workloads with Azure services, including Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Azure Databricks, and Power BI.
• Implement medallion architecture (Bronze / Silver / Gold) and data modelling best practices, with a good grasp of SDLC processes to ensure data quality and consistency.
• Collaborate with stakeholders to translate business requirements into scalable data solutions and reusable data assets.
• Ensure data governance, lineage tracking, and compliance using Microsoft Purview and Fabric's built-in governance features.
• Monitor, troubleshoot, and performance-tune data workflows, applying FinOps thinking to manage costs while resolving bottlenecks and ensuring SLAs are met.
• Participate in CI/CD pipeline setup for data workloads using Azure DevOps and Git-based version control.