
Karim Diab
Data Engineer | KPI Reporting & Automation | Microsoft Fabric | Power BI | ETL Pipelines
Salary / Daily rate
Riyadh Saudi Arabia
Freelance, open to permanent contract
Skills
Languages
About me
Intro
Data engineer with 5+ years of experience designing and delivering automated KPI reporting pipelines and end-to-end data engineering solutions for government and enterprise clients across KSA and Egypt. Hands-on expertise with Microsoft Fabric (medallion architecture), Azure Data Factory, SQL Server, Snowflake, and SSIS building reliable, automated data pipelines processing 150K+ records daily at 99% availability. Proven track record delivering KPI reporting pipelines from raw ingestion to executive dashboards across HR, Marketing, Finance, and Operations - integrating heterogeneous source systems via REST APIs (Oracle, ERP, EPM, GIS, and cloud platforms), ensuring data quality enforcement and UAT-ready deployments achieving 87.5% ETL load reduction and 97% query performance improvement in production. Holder of Microsoft Fabric (Bronze-Silver-Gold medallion architecture), data modelling, and medallion Lakehouse architecture ingesting and transforming data across 10+ source systems with cross-functional experience across HR and Marketing KPI reporting. Holder of Microsoft Fabric (DP-700) and Power BI (PL-300) certifications, with cross-sector delivery across Finance, HR, Procurement, Operations, and PMO with strong data governance awareness and compliance with data quality, security, and access control standards.
Work experience
Senior BI & Data Engineer | Power BI Consultant
Flint International
May 2024 - Present
2 years 6 months
Riyadh Saudi Arabia
– Architected enterprise ETL pipelines using SSIS, integrating 7+ source systems (CRM, ERP, GIS, Retail, Internal Portal, External Portal, EPM) into a centralized SQL Server DWH processing 80K+ records daily at 99% availability - using structured 8-phase DWH methodology; conducted business workshops, defined 400+ KPIs, and delivered the first working dashboard in 7 weeks across a complex government environment. – Installed, configured, and optimized Microsoft SQL Server across 3+ server environments - instance setup, database configuration, indexing, and storage optimization; troubleshot and resolved 15+ critical performance issues across SQL Server and ETL pipelines - reducing average query execution time by 97% and eliminating recurring refresh failures. – Designed Star & Snowflake schema dimensional models - 5 fact tables, 15+ dimensions, SCD Type 1 & 2 — powering scalable enterprise reporting; designed scalable data ingestion patterns (Full Load / Incremental / CDC) across 7+ heterogeneous source systems - ensuring reliable, low-latency data availability for all downstream reporting layers. – Ensured adherence to defined SLAs for data freshness and availability - guaranteeing daily data delivery by agreed deadlines and maintaining 99% pipeline uptime across all production environments; reduced storage footprint by ~65% via SQL Server compression - enabling real-time national indicators updated daily (previously monthly). – Implemented data validation and reconciliation frameworks to ensure enterprise data accuracy - reducing data quality issues via proactive anomaly detection and pipeline monitoring; implemented monitoring, logging, and alerting mechanisms to ensure production pipeline stability and operational readiness across client environments. – Connected to and extracted data from 10+ source systems including SQL Server, Oracle Fusion HCM, ERP, EPM, GIS, and CRM developed automated REST API connections with daily token refresh automation ensuring uninterrupted data extraction across all 75+ reporting assets. – Designed and optimized SSAS Tabular & Multidimensional cubes as enterprise semantic layer - implementing aggregations, partitioning, and model optimization to achieve sub-second query response times; powered 75+ Power BI dashboards and 20+ PMO reports tracking 400+ KPIs for Senior Leadership (CEO, HRH, Sector Heads) across Finance, HR, Procurement, Operations, PMO, GIS, EPM, and CRM. – Implemented dynamic RLS and RBAC securing role-based access for 120 concurrent users aligned with government confidentiality standards; designed data security frameworks covering encryption, masking, and access control aligned with enterprise governance and regulatory standards. – Produced data lineage documentation, data flow diagrams, and architecture documentation aligned with enterprise governance standards - including requirements docs, data dictionaries, KPI definitions, user guides, and handover docs; mentored 10+ colleagues across teams and drove platform adoption across 120+ government users via training sessions and hands-on support.
Personal Project
Jan 2025 - Present
1 year 10 months
Cloudera Big Data Pipeline - Hands-On Project
Jan 2025 - Present
1 year 10 months
– Hands-on project on Cloudera CDP Public Cloud ingested raw transactional datasets into HDFS and designed Hive tables with partitioning and bucketing strategies to optimize query performance on large-scale datasets. – Implemented PySpark transformation jobs using Spark SQL for distributed data processing and aggregation applied data cleansing, type casting, and business logic transformations on multi-source datasets loaded into the Cloudera data lake. – Leveraged Impala for low-latency SQL queries on Hive-managed tables in HDFS - compared query execution plans and tuning strategies between Hive and Impala for analytical workloads.
Sales Revenue Analytics Platform
Jan 2025 - Jan 2025
1 month
– Built an end-to-end Sales Revenue Analytics Platform on Microsoft Fabric - ingested 500K+ transactional records into a Fabric Lakehouse using Data Factory pipelines, applied Spark (PySpark) for large-scale transformation, and built a Gold-layer semantic model with DirectLake mode delivering sub-second Power BI query performance. – Developed Python (Pandas, Scikit-learn) ML models for revenue forecasting and anomaly detection - applied Random Forest and Linear Regression achieving 92% forecast accuracy; integrated predictive outputs and risk pattern detection directly into Power BI dashboards via Fabric Lakehouse. – Designed 10+ interactive Power BI dashboards covering revenue breakdown, product performance, regional sales trends, and YoY variance analysis - using advanced DAX (Time Intelligence, dynamic KPIs) and custom visualizations. – Implemented data integrity checks and automated validation using SQL (T-SQL + KQL) within Fabric - ensuring accurate, real-time reporting across all dashboard layers with full data lineage documentation.
BI & Data Engineer
Pegasus Operational Excellence
Apr 2023 - May 2024
1 year 2 months
Remote
– Designed multi-dimensional SSAS models (MDX) and delivered 20+ Power BI dashboards across 6 business departments - reducing query refresh time by 12% for 50+ users. – Embedded Power BI reports into internal business applications via Power BI Service APIs enabling automated reporting access; developed custom Power BI visuals to address specific reporting requirements beyond standard visuals. – Designed and delivered 30+ Power BI dashboards for management and administrative teams covering employee KPI tracking, operational performance, and management-level insights for 50-100 users. – Built and maintained ADF + Snowflake ELT pipelines processing 150K+ records daily - ensuring data accuracy and reliability for all reporting layers. – Analyzed and prepared large-scale government datasets using Alteryx - processing ~80K records/day from multiple ministry sources. – Delivered 15+ Power BI dashboards for government policy monitoring and analytics - enabling data-driven decision-making across ministry departments and reducing reliance on manual data preparation. – Defined and implemented data visualization standards and best practices across 3 client engagements (Danone, Mantrac, Ministry of Planning) - standardizing report templates, visual design guidelines, and KPI presentation frameworks adopted by 100+ users across government and enterprise teams. – Leveraged diverse analytics tools across all client engagements: DAX & Power Query (M) for semantic modeling and data transformation, Apache Spark (PySpark) via ADF + Snowflake pipelines (150K+records/day), SQL for data extraction and performance tuning, and Python (Pandas, NumPy) for statistical analysis and pattern identification.
Personal Project
Jan 2023 - Jan 2024
1 year 1 month
Performance & Governance Simulation
Jan 2024 - Jan 2024
1 month
– Simulated enterprise data platform with star-schema model and full ETL pipelines - implementing performance optimization via partitioning, columnstore indexes, and pre-aggregations for production-level query speed. – Built governance framework with RLS, RBAC, metadata catalog, and lineage tracking - enforcing data security and compliance standards aligned with regulated enterprise environments. – Developed SSAS Tabular semantic layer and Power BI dashboards tracking operational and analytical KPIs demonstrating end-to-end BI delivery from data model to executive reporting layer and validating enterprise-grade architecture patterns.
Enterprise DWH
Jan 2023 - Jan 2024
1 year 1 month
– Built end-to-end ETL workflows using Informatica PowerCenter and IICS (IDMC) - covering full pipeline design from source to target on sample enterprise datasets. – Implemented SCD Type 1 & 2 mappings for historical data tracking and dimension management. – Developed and rebuilt multiple reusable mappings and mapplets - applying best practices for transformation logic, error handling, and workflow orchestration. – Explored IICS cloud features: connections, taskflows, and cloud-based data integration capabilities.
BI & Data Engineer
Blue Ocean
Aug 2021 - Mar 2023
1 year 8 months
Cairo, Cairo Governorate, Egypt
– Developed 10+ Power BI dashboards and reports providing operational and executive insights across business domains - supporting faster, evidence-based decision-making for management teams. – Built 15+ SSIS ETL pipelines ensuring reliable, automated data integration; used T-SQL and Python for data extraction and analysis - eliminating manual data handling and improving data consistency across reporting layers. – Introduced and applied data visualization guidelines and reporting standards establishing consistent design patterns, chart selection rules, and data presentation frameworks across all Power BI reports delivered to business stakeholders. – Utilized core analytics technologies: DAX & Power Query (M) for report modeling and data transformation, T-SQL for ETL pipeline development, and Python for data analysis and insight generation across all business reporting domains.
Education
Information Technology Institute (ITI)
Professional Diploma, Business Intelligence Track
2023 - 2024
5 months
– Core curriculum: Enterprise BI, Power BI, SSAS, SSRS, SSIS – Graduation Project: Telecom Churn Analysis - SSIS → SSAS → SSRS → Power BI
Arab Open University
Bachelor of Computer Science, Computer Science
2018 - 2022
3 years 10 months
– GPA: 3.39 – Minor: Computer Science – Graduation Project: Navigation System App - Grade A+
Licenses & certifications
Microsoft Certified: Fabric Analytics Engineer Associate
Issued: –
DAMA CDMP
Issued: –
Alteryx Designer Advanced Certification
Issued: –
Alteryx Designer Core Certification
Issued: –
Microsoft Certified: Power BI Data Analyst Associate
Issued: –
Microsoft Certified: Fabric Data Engineer Associate
Issued: –