Senior Data Engineer

We're seeking a Senior Data Engineer with deep expertise in Microsoft Fabric to lead technical architecture and implementation of enterprise data solutions. You'll design end-to-end lakehouse architectures, optimize warehouse performance, build real-time analytics solutions, and mentor junior engineers.

Key Responsibilities

Architecture & Design (35%)

• Design lakehouse architectures leveraging Fabric’s OneLake, Warehouses, and Real-Time Analytics.
• Architect multi-domain Fabric solutions with strong data governance and medallion patterns.
• Define and optimize Warehouse schemas (star schema, snowflake schema) for analytics queries.
• Architect Real-Time Analytics solutions using KQL and streaming ingestion.
• Plan OneLake organization strategy including workspaces, folders, and shortcut architecture.
• Establish data governance frameworks using Fabric’s built-in features and external tools.

Development & Execution (35%)

• Develop complex ETL pipelines in Fabric Data Factory with advanced error handling.
• Optimize Warehouse queries using window functions, CTEs, and query hints.
• Build Spark notebooks for scalable data transformations with performance tuning.
• Implement Real-Time Analytics dashboards using Power BI and KQL.
• Design and enforce data quality frameworks with automated validation.
• Conduct code reviews and establish data engineering best practices.

Platform & DevOps (20%)

• Design CI/CD pipelines using Fabric’s deployment pipelines and Git integration.
• Optimize Fabric capacity planning and resource utilization.
• Implement security and access control with Fabric’s role-based access.
• Design disaster recovery and backup strategies for critical Fabric items.
• Manage monitoring and alerting for production Fabric workloads.

Pay: ₹1,200,000.00 - ₹1,880,000.00 per year

Benefits:

• Flexible schedule

Work Location: In person