
A. Ali HADID
Senior Data Engineer | Spark, AWS
Salary / Daily rate
Paris, France
Freelance, open to permanent contract
Skills
Languages
About me
Intro
Data Engineer with 5+ years of expertise in Python, Spark, and cloud platforms (AWS/Azure). Led data platform implementations for customer loyalty programs and automated ML deployments, reducing operational costs significantly. Specialized in multi-source data integration and real-time processing solutions.
Work experience
Data Engineer
SafranFreelance
Apr 2024 - Present
2 years 7 months
91400 Saclay, France
Python, Spark, Scala, Airflow, MongoDB, API, AWS services
Big Data Engineer
Cora InformatiqueFreelance
Sep 2022 - May 2023
9 months
Metz, France
Mission: Analysis and development as well as support of certain applications used within Cora hypermarkets, mainly on AWS big data environments. Tasks: • The implementation of a data platform dedicated to the customer loyalty program • Collection of multi-source data (parquet, csv) to feed the DataLake S3 • Realization of developments, unit tests and technical recipes (Python, Spark) • Exposing and testing the results of spark processing for the business in the Snowflake environment (Sql) • Optimization of marketing costs and sms sent to customers • The processing of multi-source data from the DataLake (parquet, csv) • Configuration of parameters and calls to python functions (Yaml). • Digitization of receipts • Deployment and testing of developments in the AWS environment • Participation in various agility meetings (Jira, Daily) Technical environment : • Environment: AWS (S3, EMR, Pipeline), PyCharm, Snowflak • Languages: Python, Sql • Technologies: Spark, git, Jira • Systems: Windows, AWS Ec2
Capgemini Engineering
Jun 2019 - Oct 2022
3 years 5 months
Vétheuil, France
Data Engineer
May 2022 - Oct 2022
6 months
Vétheuil, France
Client: Carmignac Mission: Participation in the project for the creation of a new data platform based on the Azure ecosystem. Tasks: • Collection of multi-source data (ADLS, Postgresql, deltalake) for the creation of Spark scala dataframes • Spark scala development (Databriks) for data processing (Sql, json) • Automation of the creation of deltalakes from Sql server tables in the data factory environment • Creation and manipulation of Postgresql databases (Azure devops) • Participation in various agility meetings (Azure devops) Technical environment : • Environment: Azure, Databriks, Data factory, Postgresql • Languages: Scala, Sql • Technologies: Spark, gitHub • Systems: Windows VDI
AI/ ML Engineer
Jan 2022 - May 2022
5 months
Paris, France
Mission: Participation in the G2IP project for the automatic detection of mechanical objects G2IP. The implementation of automatic learning models (ML / Deep Learning) for the detection of objects. Tasks: • Analysis and study of existing technologies in order to propose technical solutions for the detection of objects in images based on automatic data learning techniques. • Testing and adaptation of ML models for image processing and object detection • Development and testing of demonstration prototypes • Collection of data for the creation of the dataset of mechanical objects Technical environment : • Environment: Tensorflow, pyTorch • Languages: Python • Technologies: Deep learning • Systems: Linux
Data Engineer
Aug 2021 - Dec 2021
5 months
Paris, France
Mission: As part of an upgrade of my skills in Data Engineering, I integrated a full-time professional training on different Big Data / Devops tools. Learning and carrying out projects on data engineering tools Tasks: • Creation of ML models for the detection of fraudulent banking transactions • Deployment of ML models in Big Data environment via Spark • The development of micro-services / API (Flask / FastAPI) • Isolation and orchestration of the development environment (Docker / Kubernetes) • Automation of tasks via Airflow (Creation of an ETL) • Choose, set up, and populate a database from a dataset (SQL) • Creation of a data warehouse by storing and partitioning relational databases (HDFS/ HIVE) Technical environment : • Environment: SPARK, HADOOP, HIVE, HBASE, DOCKER, FLASK, FASTAPI, KUBERNETS, MONGODB, AIRFLOW, PANDAS, NUMPY, GIT, SKLEARN • Languages: PYTHON, SQL • Technologies: DEVOPS • Systems: LINUX (AWS EC2)
ML/ SW Engineer
Jul 2020 - Jul 2021
1 year 1 month
Paris, France
Mission: In the Research and Innovation division of Capegimini Engineering, I was in charge of: • Development of a mobile application for the verification of compliance with standards for the batteries of electric or hybrid vehicles. • Development of virtual environments for autonomous vehicles • Deployment of Machine Learning models for the detection of tumors from MRIs Tasks: • Analysis and study of existing technologies in order to propose appropriate solutions to our needs • Development and testing of demonstration prototypes • Follow-up of certification training in development and data analysis. • Converted a desktop application in Javascript / node js to a mobile application • Python development of scripts for the control of autonomous vehicles during numerical simulation • The Python development (Tensorflow, Keras) of a decision support system based on Deep Learning techniques for the detection of tumors on MRIs. • Certification and development of Data Science skills Technical environment : • Environment: TENSORFLOW/ KERAS, SCANER STUDIO, PANDAS, NUMPY, SQL, CORDOVA • Languages: PYTHON, JAVASCRIPT, HTML/ CSS • Technologies: NODE.JS, GIT • Systems: WINDOWS, LINUX
Software engineer for Autonomous and Connected Vehicles
Jun 2019 - Jul 2020
1 year 2 months
1 Avenue du Golf, 78280 Guyancourt
Mission: • The implementation and development of a traffic model for autonomous vehicles from SCANeR studio (Python, API) • Development (Python), test, and validation of modules of an HMI installed on an HPC server (Linux): [dev-staging-prod env, test, PR reviews] • Implementation of scripts to automate testing and analysis of simulation results • Validation of development requests for the SCANeR studio simulator • Conducted regression testing, analyzed results and submitted observations to development team • Reviewed project specifications and designed technology solutions that met or exceeded client expectations.
Software Engineer
AV Simulation
Jan 2018 - Dec 2018
1 year
1 Cours de l'Île Seguin, 92100 Boulogne-Billancourt
> Mission: • Support and maintenance on the AVSimulaiton SCANER Studio simulator for their customers • Detection and diagnosis of product bugs • Testing of bug fixes and validation of updates • Development and correction of scripts • Participation in innovative projects of the client • Technical coordination in an international context with different departments (development, support and maintenance, systems, sales) • Response to customer calls and emails > Link: avsimulation.fr
Ingénieur R&D : Le Développement d'une carte de perception pour le véhicule autonome | Stage Master
Groupe PSA
Feb 2017 - Oct 2017
9 months
69340 Francheville, France
• Design and development on SCANer Studio / MATLAB of a generic and dynamic method for constructing semantic maps from real-time sensor data for autonomous vehicles • Reduce the complexity and code optimization of developed algorithm
Intelligent platform for NAO robot based on Deep Learning | Stage Master
Université Mohamed Khider de Biskra
Jan 2016 - Jul 2016
7 months
Kouba, Algeria
• Implementation of an intelligent platform for "NAO" robot based on Deep Learning models • Integration of Tensorflow platform for Deep Learning models in my Python program in order to process unstructured data, especially images • Improve robot autonomy and data processing capability thanks to Deep Learning algorithms • Implementation of real simulation tests for the proposed approaches (A humanoid robot tech digits for children)
Towards Internet services based on user mobility
Université Mohamed Khider de Biskra
Feb 2014 - Jul 2014
6 months
Kouba, Algeria
• Realize Internet/ micro services platform based on Wifi Users mobility and their web profil (cookies) • Python development of a system uses t-shark under Linux which trucks WIFI users in passive mode (Beacons, SQLite) • Installation of the system on RaspBerry PI devices placed in several areas of a store in order to increase profits due to an intelligent web advertising system for customers based on their mobility inside the store. • Installation of the system on RaspBerry PI devices placed in several areas of a university library (exams period) in order to do statistics on recorded WIFI signals (PC, phones, ..) of library users
Startup weekend participant
Global Entrepreneurship Week Algeria
Nov 2013 - Dec 2013
2 months
Oran, Algeria
Education
Université de Technologie de Compiègne (UTC)
Master's degree
2016 - 2017
1 year 1 month
Université Mohamed Khider de Biskra
Master's degree
2014 - 2016
2 years 1 month
Université Mohamed Khider de Biskra
Bachelor’s Degree
2011 - 2014
3 years 1 month