Bachir Diaby

💡 Data Engineer | Data Warehousing & Business Intelligence (BI) Enhanced Snowflake Data Warehouse by integrating new datasets and optimizing reporting pipelines: ✅ Data Transformation & Preparation: Mapping, fact tables, aggregation, and scheduling with Stambia ✅ Developed advanced transformation logic using Snowpark to handle complex data processing natively within Snowflake. ✅ Managed data ingestion from REST APIs and files stored in Azure Blob Storage. ✅ Reporting Data Sources: Configured and optimized data pipelines for Tableau ✅ Designed and implemented a scalable weather forecast ingestion pipeline using Snowpark and the OpenWeather API, transforming raw data into a structured five-day format to power a marketing automation system that triggers targeted SMS campaigns during adverse weather conditions (e.g., tire promotions). ✅ Built a secure Spring Boot REST API for generating Google ID tokens using service accounts, with JWT-based authentication and dynamic user access via URL parameters. ✅ Designed and implemented a robust, modular data deduplication and enrichment pipeline in Snowflake Snowpark—leveraging Python UDFs, stored procedures, window functions, and igraph—to process, merge, and dedupe millions of mobility device records across multiple brands and environments. ✅ Migrated legacy ETL workflows from Stambia to a modular dbt architecture in Snowflake, refactoring complex SQL into reusable models with Jinja macros, implementing schema-based testing, and building enriched mart layers—including a 5-day weather forecast model—to ensure scalable, validated, and production-ready data pipelines. 🔹 Tech Stack: Snowflake | Stambia | Tableau | SQL | dbt | Streamlit | Python | Snowpark | GitLab | Java

💡 Data Engineer | Data lakes & Business Intelligence (BI) 🔹 Project Obi-One Designed and implemented a data architecture for sales, finance, and inventory management, ensuring scalable and efficient analytics: ✅ Engineered scalable data lakes and warehouses to centralize finance, sales, and logistics data. ✅ Developed ELT pipelines using Python and Airflow to ingest data from CSV, JSON, XLSX, and APIs. ✅ Data Transformation & KPI Calculation ✅ Workflow Orchestration with Apache Airflow ✅ Utilized GitHub for version control and Azure DevOps for CI/CD deployment of transformation scripts and workflows. ✅ BI View Creation for Business Insights ✅ Collaboration with Business Teams for Data-Driven Decision-Making 🔹 Tech Stack: Apache Airflow | Azure Data Lake | Snowflake | SQL | Python | API | GitHub | CI/CD

💡 Data Engineer | Migration & Master Data Management (MDM) 🔹 Project OXYGEN (July 2022 – June 2023) Migrated the payroll system of 6 Business Units to Workday, ensuring seamless data transition: ✅ Technical Environment Setup for Migration ✅ ETL Pipeline Modeling & Deployment (Stambia) to load and clean HR/payroll data into Workday, improving data quality. ✅ Business Rule Mapping & Automated data rejection handling and transformation for efficient flow monitoring ✅ Integrated GitHub for version control and set up CI/CD pipelines with GitHub for seamless deployment. ✅ Ongoing Maintenance & Enhancements 🔹 Project JASPER (Dec. 2021 – July 2022) Led MDM integration and data consolidation for Adeo, ensuring high-quality master data: ✅ Organization Data Integration into Semarchy xDM ✅ Match & Merge Rule Implementation for MDM Consolidation ✅ User Experience & Interface Configuration in Semarchy ✅ Pipeline Development (GCP Datafinder, Stambia) for CSV, Excel, GCS, and BigQuery Sources 🔹 Tech Stack: Semarchy xDM | Stambia | GCP | PostgreSQL | JSON | Python (Pandas, SQLAlchemy) | GitHub | Jira

💡 Data Engineer | Data Integration & Automation Designed and optimized data exchange and automation processes for student management, enhancing operational efficiency: ✅ Designed API-based data flows to automate data exchange between internal systems (PPS, Dokeos). ✅ Managed international student enrollment workflows and diploma supplement generation. ✅ Enabled structured data transformation using Talend, optimizing operational workflows. ✅ Focused on UI/UX design for Aurion forms and dashboards to improve internal tool usability ✅ Optimization of International Student Onboarding Processes 🔹 Tech Stack: Talend | API | Aurion | XML | Java | HTML | Postman | UI/UX

💡 Data Engineer | Maintenance & Optimization Managed incident resolution and continuous improvement for Auchan Énergie and Auchan Production Alimentaire, ensuring system reliability and efficiency: ✅ Incident Tracking & Resolution ✅ Process Evolution & Optimization 🔹 Tech Stack: Talend | XML | EasyVista | Google Code

💡 Data Engineer | Data Integration & API Development Designed, optimized, and maintained ETL pipelines and application services for multiple clients, ensuring seamless data integration and performance: ✅ Developed reusable data pipelines using SSIS for various marketing and sales projects. ✅ Applied CI/CD practices using Azure DevOps and automated deployments ✅ Database Management & SQL Query Optimization: SQL Server ✅ Web API Development & Enhancement: .NET, Java, C# ✅ Performed application maintenance and debugging for consistent system uptime. ✅ Introduction to Microsoft Azure Cloud Environment 🔹 Tech Stack: SSIS | SQL Server | Power BI | Azure Data Factory | Talend | .NET | Java | C# | Postman | GitHub | Azure DevOps