Azure Engineer

Job highlights

• Expertise in Microsoft Fabric, PySpark, Azure DevOps, Terraform/Bicep, and DevSecOps practices
• Build and maintain Lakehouses, implement real-time data solutions, develop CI/CD pipelines, enforce security and governance, monitor and optimize platform operations

Role & responsibilities

Microsoft Fabric engineering

Build and maintain Lakehouses, Warehouses and SQL analytics endpoints; implement medallion layers with Delta tables, V-Order, OPTIMIZE/VACUUM and partitioning strategies.
Develop ingestion and orchestration with Data Factory pipelines, Copy jobs, Dataflows Gen2 and Notebooks (PySpark, Spark SQL); configure OneLake shortcuts and Mirroring for source systems.
Implement real-time scenarios with Eventstream, Eventhouse and KQL databases, Real-Time dashboards and Activator alerts.
Build Power BI semantic models (Direct Lake, Import, composite), DAX measures, incremental refresh and RLS/OLS.
Tune Spark environments (starter pools, custom pools, libraries, high-concurrency sessions) and SQL query performance; monitor capacity consumption with the Fabric Capacity Metrics app and Monitoring hub.
Execute migrations from Synapse, ADF, SSIS and Databricks: inventory, conversion, reconciliation testing and cutover.
Configure Fabric Git integration with Azure DevOps Repos or GitHub; enforce branching, pull-request policies and code-review standards for notebooks, pipelines and semantic models (TMDL/PBIP formats).
Build CI/CD pipelines in Azure DevOps (YAML) or GitHub Actions using Fabric REST APIs, fabric-cicd, deployment pipelines and parameter files for environment promotion.
Write and maintain Terraform (azurerm, azapi, Microsoft Fabric provider) or Bicep modules for capacities, workspaces, connections, networking, Key Vault and role assignments.
Implement security gates in pipelines: SAST (CodeQL, SonarQube), secret scanning, IaC scanning (Checkov, Trivy), dependency scanning, unit tests for notebooks (pytest, Great Expectations / data-quality checks) and approval gates.
Use OIDC / workload identity federation and managed identities; store secrets in Azure Key Vault; eliminate hard-coded credentials.
Remediate findings from Microsoft Defender for Cloud, DevOps security and pipeline scans within SLA.
Implement workspace roles, item permissions, OneLake security roles, Entra security groups and service principals per the access model.
Configure Private Links, Managed Private Endpoints, VNet/on-premises data gateways and trusted workspace access.
Apply Purview sensitivity labels, DLP policies, scanning and lineage; support periodic access reviews and audit evidence collection.
Stream Fabric and Azure activity/audit logs to Log Analytics and Microsoft Sentinel; build alerts for failures, throttling and anomalous access.
Own runbooks, monitoring and alerting (Azure Monitor, Log Analytics, Fabric Monitoring hub); act as L3 escalation for data-platform incidents.
Drive root-cause analysis, problem management and automation of repetitive operational tasks (PowerShell, Python, Azure CLI, Fabric CLI).
Track and optimise cost: capacity pause/resume schedules, workload scheduling, storage lifecycle and FinOps reporting.
DevSecOps implementation

Security and governance operations

Operations and reliability