
Nicolas Dangerard
Senior Data Engineer DevOps | Kafka, Spark
Salaire / Taux journalier
Nantes, France
Freelance
Peut venir sur site
Expertises
Langues
À propos
Introduction
Senior Data Engineer with 10+ years building enterprise-scale data pipelines across major financial institutions. Expert in real-time streaming architectures using Kafka/Spark, CI/CD automation with Kubernetes/Terraform, and synthetic data solutions. Currently delivering data reconciliation systems at Crédit Agricole. I transform complex data challenges into robust, automated solutions that enhance performance and ensure compliance.
Expérience de travail
Senior Data Engineer Devops: Kafka|Spark|Ansible|Airflow
Crédit Agricole Technologies et Services
janv. 2025 - Présent
1 an 10 mois
Nantes, France
- Data engineer and Devops on application of credit and energy performance data reconciliations - Rebuild and implement CI/CD pipelines - Offers an orchestration solution based on Airflow - Transforms part of batch processing into streaming Credit and energy performance data reconciliations: ∞Gitlab CI and Ansible CI/CD pipelines to deploy applications, ∞Real time Kafka Pyspark pipelines, ∞Orchestration with Airflow DAGs ∞Ansible, PySpark, Spark streaming, Kafka, Kubernetes, Python, Airflow, Gitlab CI
Senior Data Engineer Devops: Python|Redis|Kubernetes|Terraform
DOPPFreelance
août 2024 - janv. 2025
6 mois
Nantes, France
- Data engineer and Devops on cryptocurrencies trading pipelines project - Build and implement CI/CD pipelines - Develop real time data ingestion pipelines Cryptocurrencies trading pipelines project: ∞Real time python pipelines with Redis ∞Orchestration with Airflow DAGs ∞GitHub Actions CI/CD pipelines ∞Kubernetes cluster build with Terraform ∞AWS, EKS ∞Python, Redis, Airflow, Kubernetes, GitHub Actions, Terraform
Senior Data Engineer Devops: Kafka|Spark|Kubernetes|Terraform
Société Générale
févr. 2021 - mai 2024
3 ans 4 mois
94120 Fontenay-sous-Bois, France
- Solution Architecte and Tech Lead on Synthetic Data Generation project - Build and implement CI/CD pipelines - Develop Big Data Compare Tool and Applicative Decommissioning Tool Synthetic Data Generation project: ∞Single et Multi table synthetic data application to answer privacy constraints on data ∞Solution architecte and Tech Lead ∞On premise, Azure ∞Python, Scala, Spark, Kafka, Airflow, ML Algorithms, PostregSQL, Springboot, ReactJS CI/CD pipelines: ∞Industrialize integration and deployments process to reach out DevOps philosophy ∞Develop Jenkins CASC scripts, Ansible playbooks and Kubernetes and Terraform workflows ∞Groovy, Yaml, Github, Jenkins, Terraform, Kubernetes, AKS Tooling: ∞Migration to new Cloudera platform needs compare tool to validate and decommissioning tool ∞Develop Python Presto compare tool and Decom tool based on Ansible playbooks modules ∞Python, Yaml, Presto, Ansible
Tech lead automation tests tool: Kafka|Kafka-streams|ScalaTest
STET
févr. 2015 - mars 2020
5 ans 2 mois
Paris, France
- Tech lead Automation test tool - Develop functional and non functionals tests - Monitoring performances Big Data Automation test tool: ∞Instant payment platform needs integration tests tool to validate use cases ∞Tech Lead on Big Data Automation test tool project ∞Agile Method ∞Develop Scala tests with Kafka injector ∞Develop monitoring tool for performances analysis ∞Jenkins, ScalaTest, Kafka, Kafka-streams, Cassandra, ELK
MOE consultant: Project Management|Functional specifications|Tests and reports
BNP Paribas
nov. 2010 - mars 2015
4 ans 5 mois
94160 Saint-Mandé, France
- Writing detailed functional specifications - Development and functional testing - Packaging project management Packaging project management: ∞manage and distribute fixes and evolutions for International Retail Banking ∞train three teammates in Morocco MOE consultant: ∞write functional specifications ∞test application and test report ∞patch COBOL application
Formation
EIC Cherbourg
Diplôme d'ingénieur, Généraliste de production
2006 - 2009
3 ans 1 mois