Imen Chebbi
Senior Data Engineer | Python, Spark
Salaire / Taux journalier
Paris, France
Freelance, ouvert au CDI
Peut venir sur site
Expertises
Langues
À propos
Introduction
Data Engineer with PhD expertise specializing in Python, SQL, Spark, and big data solutions. Currently modernizing data ingestion pipelines at RTE, with proven experience building Kafka streaming flows and optimizing Hadoop clusters. Ready to transform your data infrastructure with cutting-edge engineering and automation.
Expérience de travail
Big Data Engineer
RTE Réseau de Transport d'Electricité
avr. 2023 - Présent
3 ans 7 mois
92800 Puteaux, France
• Analyzing the existing and then refactoring of data ingestion chains to modernize and optimize the future work • Fixing the bugs and production issues • Evolutions: addition of new data flows (ex: Kafka streaming) Development of Spark jobs (PySpark) for transformation, loading and deployment on Yarn cluster • Creation, manipulation and use of Hive tables • Archiving data in Hadoop, manipulation of files in CSV, JSON, XLS, XML, PARQUET format, and ensuring partitioned data storage on HDFS • Automation of project deployment via DevOps methods
Big Data Engineer
gfi
mars 2021 - mars 2023
2 ans 1 mois
Paris et périphérie
Formation
Université Paris 8
Thèse de doctorat
Université de La Manouba
Ingenieur