Mouhammad Diakhate

I help the team reflect on new challenges implied by the acquisition of new subsidiary companies in Netherland and Norway by Sogelink France which involves: ✔️ Reflection on a migration strategy of the Data Lake into a modern Lakehouse ✔️ The actual migration of the existing Data Lake into Apache Iceberg ✔️ Ingestion new data coming from Netherland and Norway CRMs and ERPs (API and OData ingestion) ✔️ Reflect on a new design of the architecture that is able to support external connection while being compliant with GDPR and data privacy requirements ✔️ Refactoring of the Terraform code to improve developer experience when declaring new jobs

Redesign and refactoring of the Optisow project's Legacy preprocessing + Creation of an EDI file format parser. After a study of shipping rules and stowage optimization, I developed an EDI file parser which involved: ✔️ Creation of a data model mapping EDI format in code ✔️ Addition of design pattern best-practices (single responsibility, open-close and Liskov principle) ✔️ Refactoring of functional rules which permit over 66% of legacy code reduction ✔️ Implementation a “restow” algorithm to optimize the placement of heavy containers in the hold

MISSIONS : ✔️ Migration of legacy SQL Server Data Warehouse to Data Lakehouse Architecture using Databricks ✔️ Create Ingestion pipeline for new sources ✔️ Design Data Vault Architecture

While working with a leader client on transport, we helped the business to derive value from high volume data and leverage metrics computed by big data team to build business reports. CAPGEMINI MISSION 3: ✔️ Understand business needs for new incoming metrics and use cases ✔️ Extract data from datalake ✔️ Implement given metric rules with Spark on Databricks ✔️ Integrate new use cases into existing airflow orchestration ✔️ Validate end to end tests on development ✔️ Containerize and productionize computed KPIs ✔️ Orchestrate Data Ingestion and pipelines triggers ✔️ Monitor pipeline runs and debug failing pipelines ✔️ Migrate legacy CI/CD builds to JFrog Artefactory ✔️ Build Power BI reports

CAPGEMINI MISSION 1: Build and automate a datawarehouse from legacy excel sources ✔️ Compare Cloud providers offers ✔️ Choose the best datawarehouse architecture with a good tradeoff between price and performance ✔️ Build a star-schema datawarehouse with T-SQL on Azure SQL DB ✔️ Implemented metrics in dev environment on Apache with Spark / Databricks ✔️ Orchestrate pipeline steps and automate data ingestion on Azure Data Factory ✔️ Store resulting data into an Azure SQL DB Data Warehouse for BI reports ✔️ Create adapted repots on Power BI

Working in a project for a client in real estate, I worked on building a Data Warehouse aimed for BI reports. CAPGEMINI MISSION 2: ✔️ Provision Azure Cloud resources ✔️ Build a star-schema datawarehouse with T-SQL on Azure SQL DB ✔️ Ingest data into Azure Storage Data Lake ✔️ Implement T-SQL queries for data extraction ✔️ Orchestrate pipeline steps and automate data ingestion on Azure Data Factory ✔️ Store resulting data into an Azure SQL DB Data Warehouse for BI reports ✔️ Create adapted repots on Power BI

✔️ MISSION 1: In collaboration with the observability team, we have builded a serverless ETL pipeline based on Knative on top of a Google Kubernetes Engine cluster for automatic log format correction and ingestion coming from Kafka to Elasticsearch. This enabled observability team to not worry about logs format on the operational data side (applications and business) and focus on log exploitation on elastic search ✔️ MISSION 2: In a second project for internal use, we've worked on an automatic serverless infrastructure provisioning platform for Cloud Environments. By the use of Knative on top of GKE, we were able to let developers to deploy their desired infrastructure via a self-service web platform which interact with Terraform and Kubernetes behind the scene to automatically deploy resources on either GCP or AWS.

Skills: Electron.js · React.js

Skills: MySQL · Visual Basic .NET (VB.NET)

Skills: Django · Angular