Rachit Bhargava

Introduction

Senior Data Engineer specializing in building AI-ready, scalable data platforms that power machine learning and analytics. 8+ years driving data transformation across fintech, healthcare, and enterprise sectors. 🎯 Core Focus: • AI/ML Data Infrastructure: Designing data pipelines optimized for ML model training and real-time inference • Microsoft Fabric Expert: End-to-end data platform expertise covering Fabric Data Engineering, Data Factory orchestration, Synapse Analytics, and OneLake optimization • Cloud Architecture: Multi-cloud solutions using Databricks, Azure Fabric, AWS (Redshift, Glue, Lambda), GCP • Data Quality & Governance: Implementing ML-friendly data lakes with automated validation and lineage tracking 💡 Technical Stack: • Microsoft Fabric: Data Engineering, Pipelines, Synapse Analytics, Data Warehouse, Real-time Analytics • Cloud Platforms: Azure (Data Factory, Fabric, Synapse, EventHub), AWS (Redshift, S3, EMR, Lambda), GCP • Technologies: Python, PySpark, SQL, Apache Airflow, Kafka, DBT, Pandas • Specializations: Real-time ETL, Feature Engineering for ML, Data Warehousing, Medallion Architecture, Lakehouse patterns 📊 Impact: • Optimized data pipelines supporting 100M+ events/day using Microsoft Fabric • Reduced ML pipeline latency by 40% through Spark optimization • Built automated data quality frameworks reducing manual validation by 80% • Led teams delivering enterprise-scale data solutions for predictive analytics and fraud detection • Migrated legacy data warehouses to Microsoft Fabric with zero downtime Open to: Dubai, UAE | Senior/Staff Data Engineer Roles | Remote-friendly positions

Liens