Alaa Zreik

- Migrating data pipelines from Azure Synapse Analytics to Databricks and AWS, integrating Delta Lake on S3 for reliable transactional storage. - Managing data cataloging with Unity Catalog to organize and secure centralized data. - Processing data with Spark on Databricks, storing processed data in the Aurora RDS database for use through an API intended for consumption by users, orchestrated via workflows to optimize ETL. - Designing a streaming solution with Delta Live Tables (DLT) and Autoloader to ingest Aurora data in real time, preparing it for analysis in Power BI. - Participating in infrastructure management following the Infrastructure-as-Code (IaC) approach. - Contributing to the documentation of data processing architecture to ensure a comprehensive understanding and system maintenance. - Implementing CI/CD automation with GitHub Actions for continuous testing and deployment. - Monitoring data with Grafana to detect anomalies in processed data.

- Implementation of various data architectures to meet the client's cross-functional needs in the banking sector - Raw data ingestion into the Data Lake (S3) through both batch and streaming processes - Development of ETL processes using Glue Jobs and Lambda Functions to transform and load data into S3/MongoDB - Orchestration of pipelines using Airflow/Step Functions - Monitoring through CloudWatch/DataDog - Creation of all resources using infrastructure as code (Terraform) - Automation of CI/CD deployment using GitLab and Jenkins - Collaboration within an Agile framework at scale, following the SAFe methodology

Title : Main contributor of the design and development of “DALGOCOL” data platform in collaboration with interdisciplinary researchers at the National library of France (BNF) Topic : The work is motivated by the need to detect the degradations of the documents at the BnF automatically in real-time. This work includes the integration of the BnF data, including the past conservation processes on the documents and the readers’ requests, the processing of this data on relational databases and real-time processing on big data streaming frameworks in data pipelines. Main duties performed : - Analyze functional requirements and determine the necessary data model - Work cross-functionally with Data Scientists to understand their needs and ensure necessary data transformations are made - Contribute to the technical design of data solutions that meet business requirements - Design, manage and develop data transformation pipelines (batch and real-time) - Design and implement data ingestion processes - Ensure the proper functioning of data ingestion and processing pipelines - Contribute to the design and enrichment of the data warehouse - Publish scientific articles in international and national journals and conferences - Assist and present at international and national conferences - Supervise and teach students at the University of Versailles (C, Python, SQL)

Title : Study of the data quality of the Louvre Museum Topic : The internship focused on the problem of the quality of the conservation data at the Louvre Museum. Main duties performed : - Collect, integrate and process the Louvre data - Develop a demo to study the quality of the conservation data