
Ababacar Sy Badiane
Senior Data Engineer | GCP & PySpark
Salaire / Taux journalier
Paris, France
Mobilité : Paris, Lyon, ...
Freelance
Peut venir sur site
Expertises
Langues
À propos
Introduction
Senior Data Engineer with 7+ years building scalable data pipelines across AWS, GCP, and Databricks environments. Proven track record at Orange, EDF, and Aviv Group developing KPIs and optimizing ETL infrastructure for high-volume datasets. GCP-certified specialist in PySpark, Spark, and cloud data architecture, delivering GDPR-compliant solutions that drive business insights and customer experience.
Expérience de travail
Senior Data Engineer
Decathlon DigitalFreelance
avr. 2024 - Présent
2 ans 7 mois
Paris, France
Senior Data Engineer on "Custom Tracker" topics in AWS, Databricks environment with PySpark pipelines orchestrated on Airflow.
Data Engineer
Aviv GroupFreelance
févr. 2022 - mars 2024
2 ans 2 mois
Senior Data Engineering, Data Quality Analyst at AVIV Group (Groupe SeLoger, Meilleurs Agents etc. ) in France, Germany and Belgium. KPI Development: Developing new key performance indicators (KPIs) for leads, campaigns, and tracking is essential for understanding the effectiveness of marketing efforts across various platforms. Utilizing tools like Google Analytics, Google Tag Manager (GTM), and Adjust demonstrates a commitment to leveraging modern analytics solutions. Data Management: Creating and maintaining complex, high-volume datasets is crucial for generating accurate insights. Adhering to precise functional specifications ensures data integrity and reliability, which are paramount for informed decision-making. Infrastructure Optimization: Building a solid and optimal infrastructure for the extraction, transformation, and loading (ETL) of data from numerous sources is fundamental for efficient data processing. Decentralizing data and implementing the Data Mesh approach within the AVIV Group indicates a forward-thinking approach to data architecture. Collaboration: Working closely with Data Scientists and Data Analysts to develop new functionalities underscores the importance of cross-functional collaboration in driving innovation and unlocking insights from data. Compliance and Security: Implementation and monitoring of processes related to GDPR compliance, security, and privacy highlight a dedication to safeguarding customer data and ensuring regulatory adherence.
Data Engineer
Orange
sept. 2021 - mars 2022
7 mois
78280 Guyancourt, France
Data Engineering and Cloud Data (GCP) In the CEM (Customer Experience Management) area, the mission consists of developing KPIs for the business to analyze customer satisfaction. KPI Development: Creating new KPIs to enrich the model for analyzing customer satisfaction. These KPIs serve as vital metrics to evaluate the effectiveness of various offers in enhancing the overall customer experience. Developing user defined functions in performing complex calculations and transformations on large datasets within the CEM system to calculate KPIs efficiently. Functional and Technical Specification: Composing detailed functional and technical specifications to guide the development process. These documents ensure clarity and alignment with business requirements and technical capabilities. Anomaly Analysis and Production Bug Fixing: Analyzing and rectifying anomalies in production to ensure the smooth operation of the CEM system. This involves troubleshooting issues, identifying root causes, and implementing appropriate solutions to maintain system integrity and performance.
Consultant Business Intelligence, Big Data
EDF
avr. 2019 - août 2021
2 ans 5 mois
Building decision-making information system focused on analyzing EDF's customer data to enhance customer loyalty, particularly utilizing data from Linky meters to tailor offers to their needs. Customer Data Analysis: analyze customer data, with a specific focus on consumption indexes from Linky meters. This analysis aims to understand customer consumption patterns to propose more personalized offers tailored to their specific needs. Creating ODI/Sqoop flows to populate the Oracle database from HIVE, HBASE etc. Reading Kafka messages deposited by suppliers such as Enedis for electricity and GRDF for gas. Developing Shell scripts to automate tasks like generating targeting files for marketing campaigns. Java development for processing with Spark. GDPR Compliance: ensure that all activities related to the collection, processing, and storage of customer data comply with the General Data Protection Regulation (GDPR). This includes obtaining customer consent and implementing security measures to ensure the confidentiality and integrity of personal data. Functional Specifications and Test Strategy: developing detailed documents outlining the functional specifications of the decision-making system as well as the testing strategy to ensure the system meets the requirements and expectations of end users. Recovery of Marketing Campaign Tracking Data: retrieve tracking data from marketing campaigns, whether through mailings or SMS. This data is crucial for assessing the effectiveness of campaigns and adjusting marketing strategies accordingly.
Software Development Engineer
GAINDE 2000
août 2017 - août 2018
1 an 1 mois
Dakar, Sénégal
Design and develop a collaborative web application, operating in Software as a Service (SaaS) mode, catering to both businesses and individuals. This platform facilitates the definition and organization of digital signature workflows. Solution Analysis and Design: analyze requirements and conceptualizing the solution architecture. This involves understanding user needs, defining system functionalities, and outlining the technical design. Backend Development with Java and JHipster: develop the backend of the application using Java, leveraging the JHipster framework. This includes implementing business logic, data processing, and integrating with the PostgreSQL database through entity generation. Integration with Public Key Infrastructure (PKI) : establish connections between the backend and PKI using web services. This involves implementing both SOAP and REST APIs for communication and data exchange between systems. Frontend Development with Angular: develop the frontend of the application using the Angular framework. This includes designing user interfaces, implementing interactive components, and ensuring a seamless user experience. Full Application Development: end-to-end development of the application, from backend to frontend, ensuring that all components work together harmoniously to deliver the intended functionality.
Développeur
SUITE SN
janv. 2017 - juil. 2017
7 mois
Dakar, Sénégal
Comme développeur d'applications (web et mobile ).
Formation
CY Tech
Master of Data Analytics and Data Engineering, Ingénierie de la donnée
2018 - 2019
2 ans
La formation a pour objectif de donner aux étudiants une large connaissance des différents aspects de la Business Intelligence, tant sur le plan du management d’un projet BI que sur celui de la technicité de mise en œuvre. Elle forme des consultants capables d’accompagner les clients dans l’analyse et la formulation des besoins, la mise en œuvre et l’évolution d’une solution décisionnelle.
Ecole Supérieure Polytechnique de Dakar
Diplôme d’Ingénieur de Conception (DIC) en Informatique, Informatique
2015 - 2018
4 ans
Ecole Supérieure Polytechnique de Dakar
DIPLÔME SUPÉRIEUR DE TECHNOLOGIE EN INFORMATIQUE (DSTI), Informatique
2013 - 2015
3 ans
Les étudiants formés sont capables de participer à la conception, la réalisation et la mise en œuvre de systèmes informatiques correspondant aux besoins des clients. le technicien supérieur en Informatique: 1. Assiste le concepteur d’applications informatiques dans la phase d’analyse du projet 2. Développe les logiciels, en assure la validation, le suivi et la maintenance
Licences et certifications
Google Cloud certified Perfossional Data Engineer
Délivré le : nov. 2021