Data Engineer - Microsoft Fabric / Azure

Data Engineer - Microsoft Fabric / Azure

Location: Remote
Posted On: 1 day ago
Experience Required: 5+ Years Experience

About Us:

Saguna Consulting partners with organizations to transform bold ideas into scalable, long-lasting solutions through a blend of strategy, technology, and execution. With a human-centered and outcome-driven approach, Saguna collaborates with product-led teams, founders, and enterprises to deliver practical, intuitive, and impactful solutions. From early-stage concepts to production-ready platforms, the company acts as a trusted advisor, builder, and long-term partner.

Overview:

We are looking for a Data Engineer to own the data platform layer end to end on Microsoft Fabric — from source system ingestion through to curated Gold Delta tables. You will build the Lakehouse, land data incrementally, and deliver a clean, well-modelled Gold layer that the reporting layer sits on top of. This is a hands-on delivery role on enterprise client engagements.

Key Responsibilities:

• Set up Microsoft Fabric workspaces and Lakehouse architecture with Silver (landing) and Gold (curated) layers, including access and capacity configuration.
• Build ingestion pipelines from Databricks Gold / summary tables, SQL Server and CSV / flat file sources using Fabric Data Pipelines, Dataflow Gen2, Notebooks (PySpark / Spark SQL) or OneLake shortcuts.
• Design and implement incremental load frameworks using watermark columns or primary key MERGE, so that each run moves only changed records instead of transferring full history.
• Convert CSV / flat file sources currently joined at refresh time into governed, scheduled Delta tables.
• Build transformation, source integration, null handling and data quality logic in the Gold layer.
• Perform Delta table maintenance — OPTIMIZE, V-Order, VACUUM, partitioning — to keep downstream Direct Lake models performing.
• Carry out discovery activities: source inventory, dependency mapping and current-state refresh baselining.
• Monitor pipelines, handle failures, and maintain runbook and handover documentation.
• Coordinate closely with the Power BI developer on Gold layer table structure, grain and shape.
• Deploy through Deployment Pipelines with Git integration.

What we Require:

• 4+ years of hands-on experience in Data Engineering.
• Hands-on Microsoft Fabric experience — Lakehouse, OneLake, Notebooks, Data Pipelines, Dataflow Gen2. Strong Azure Synapse or Databricks background with demonstrated Fabric ramp-up will also be considered.
• Advanced SQL, and Python / PySpark for notebook-based transformation.
• Solid understanding of Delta Lake internals — MERGE, schema evolution, time travel, file compaction and layout.
• Practical experience in incremental load design — CDC, watermarking and upsert patterns.
• Understanding of how Gold layer design affects Power BI semantic model performance.
• Ability to work directly with client teams for requirement gathering and status discussions.
• Good written and verbal English communication.

Preferred Attributes:

• Databricks Unity Catalog, mirroring or shortcut-based integration with OneLake.
• Azure DevOps / GitHub CI-CD for Fabric artifacts.
• Azure networking basics — private endpoints, gateways.
• Spark performance tuning.
• Microsoft certification DP-700 or DP-203

Preferred Technical Exposure:

• Data Engineer
• Microsoft Fabric
• Lakehouse , One Lake , Delta Lake
• Pyspark
• SQL
• Dataflow Gen2 , Data Pipelines , Databricks
• Azure Data Factory , Azure Synapse
• Incremental Load , ETL , Data Modelling , Spark , Data Warehousing

Would you like to grow forward together?