
Johann Morales
Senior Data Engineer | Spark & Scala
6 recommandations
Salaire / Taux journalier
6 personnes recommandent
Paris, France
Freelance
Peut venir sur site
Expertises
Langues
Recommandé par
Patrick Boivent
Natixis Corporate & Investment Banking
Responsable Applications Risque de Marché
A recommandé le 01 avril 2025
Et 3 autres personnes
À propos
Introduction
Ingénieur Data avec plus de 8 ans d'expertise en architectures Big Data dans le secteur bancaire et retail. Expert en Spark, Scala et SQL, j'ai conçu des pipelines de données robustes pour Natixis CIB et Société Générale, optimisant les calculs de PnL et implémentant des solutions de Data Quality. Je vous propose mon expertise pour transformer vos données en véritable avantage compétitif avec des architectures performantes et évolutives.
Expérience de travail
Natixis Corporate & Investment Banking
mars 2022 - mars 2025
3 ans 1 mois
Paris · Hybrid
Data Engineer
mai 2023 - mars 2025
1 an 11 mois
Paris · Hybrid
Situation: Need for a reliable and high-performance PnL calculation to integrate new data sources and meet business requirements. Task: Develop and optimize PnL calculation processes while ensuring system stability and maintainability. Actions: • Developed new PnL calculation processes and integrated new data sources • Optimized Spark jobs and migrated to Spark 3 to improve performance and reduce processing times • Implemented and maintained Power BI dashboards to monitor production • Automated deployments via CI/CD pipelines • Provided application support and production management, including on- call duties Results: • Reduced processing time by 30% • Improved reliability and simplified production monitoring
Data Engineer
mars 2022 - mai 2023
1 an 3 mois
Paris · Hybrid
Situation: Existing market reserves calculation methodology was either non- existent or obsolete. Task: Develop and industrialize new reserve calculations while ensuring system stability and performance. Actions: • Developed new reserve calculations in collaboration with prototype developers • Implemented unit and integration tests to ensure development robustness • Managed deployments and automated processes via CI/CD pipelines • Provided application support and production maintenance Results : • Improved calculation accuracy • Reduced reporting errors
Société Générale
avr. 2018 - mars 2022
4 ans
Lead Data Engineer
juil. 2019 - mars 2022
2 ans 9 mois
Situation: Need for a high-performance and scalable solution to visualize data quality control results with optimized ingestion for data visualization tools Task: Add new data sources, optimize their preparation and resources consumption, and enhance the maintainability and industrialization of the project Actions: • Integrated new data sources for control results • Prepared and transformed data for optimal consumption in data visualization tools • Developed a previously non-existent test suite • Implemented a CI/CD pipeline to automate deployments • Trained and mentored junior developers • Migrated the project to a new Big Data cluster with enhanced security standards • Led technical workshops and ensured compliance with Data Management standards Results: • Faster processing and improved accessibility of data in visualization tools • Increased project stability through testing and CI/CD implementation • Empowered team, making them independent in handling complex topics • Successful migration, ensuring better scalability and performance • 100% compliance with Data Management standards
Lead Data Engineer
avr. 2018 - août 2021
3 ans 5 mois
Situation: A data control engine was extracted from an existing project to make it reusable and applicable across multiple projects Task: Improve and modernize the application while supporting client teams in implementing their technical and functional data controls Actions: • Trained and assisted client teams in implementing their data control. • Optimized extracted code to align with Spark best practices • Developed a robust test suite • Redesigned the application to simplify client adoption of the framework • Established a CI/CD pipeline to automate deployments • Conducted technical workshops Results: • Achieved a 75% average improvement in processing performance • Enhanced ease of use for the framework • Increased project stability through testing and CI/CD • Adoption of the framework by multiple new clients
Data Engineer
Carrefour
févr. 2017 - mars 2018
1 an 2 mois
91300 Massy, France
Situation: Carrefour needed a centralized log management system to quickly identify issues and assess their impact on various systems Task: Develop a Big Data solution to collect, process, and analyze logs from various systems (servers, applications, etc.), while helping users to exploit these data in a customized manner Actions: • Set up a virtualized environment using OpenStack • Deployed and configured a Cloudera cluster for log storage and processing • Gathered user requirements to tailor system functionalities • Provided client support and training to help users efficiently exploit logs and perform custom data processing Results: • Robust log storage platform capable of ingesting several dozen gigabytes of data per day • Improved incident source identification • Rapid user adoption thanks to training and feature optimization • Enhanced log utilization with advanced correlation capabilities across multiple data sources
Data Engineer (internship)
Sanofi
nov. 2014 - janv. 2016
1 an 3 mois
Sanofilala, Guinée
Study of new Big Data technologies to improve data processing performance. Installation and administration of a Hadoop cluster (Hortonworks/Cloudera). Use of Hadoop ecosystem tools to perform performance tests. Integration of PowerCenter BDE ETL (Informatica) to create mappings and then transfer them to the Hadoop cluster.
Formation
SUPINFO
Master of Science
2013 - 2016
3 ans 1 mois
Lycée Parc de Vilgénis
BTS SIO
2011 - 2013
2 ans 1 mois
Portfolio

Data Engineer @Axa

Data Engineer @Natixis (PnL)

Data Engineer @Natixis (Reserves)

Lead Data Engineer @Société Générale (Squad)

Lead Data Engineer @Société Générale (Qure)
