
Amélie Medem
Senior Data Engineer | Machine Learning
Salaire / Taux journalier
Paris, France
Freelance
Peut venir sur site
Expertises
Langues
À propos
Introduction
Data Engineer with 10+ years building scalable data pipelines and ML solutions across public and private sectors. Led teams to process 250k+ documents, architect multi-node Hadoop datalakes, and deploy Azure Databricks platforms with robust CI/CD. I deliver end-to-end data solutions—from ingestion and NLP to Power BI dashboards—that transform raw data into actionable business insights.
Expérience de travail
Senior Data Engineer - Freelance
VizcabFreelance
avr. 2024 - oct. 2025
1 an 7 mois
Paris, France
● Designed and built new data pipelines in Azure Databricks for ingesting data to/from product applications, Azure Datalake, and PostgreSQL databases. ● Ingest Datadog metrics into Databricks, integrate them with other datasets, and visualize the insights in Power BI. ● Built and optimized models to organize and structure data from diverse applications and sources for data users to consume. ● Develop and maintain Power BI and Databricks dashboards to visualize data insights, monitor pipeline performance, and ensure data quality. ● Enhanced codebase quality by implementing best practices and establishing robust CI/CD pipelines leveraging Databricks Bundle Assets, GitLab, and SonarQube. ● Develop and implement Data Contracts as a framework to monitor data models and define clear data specifications. ● Partner with business teams to identify their needs and deliver tailored data solutions that drive value.
Cour des comptes
janv. 2019 - août 2022
3 ans 8 mois
Senior Data Engineer | ML Engineer | Product Lead
nov. 2019 - août 2022
2 ans 10 mois
Lead a team of one full-time employee and 4 contractors. ● Lead the setup of a datalake based on multi-node and multi-environment Hadoop clusters. ● Engineered robust data pipelines for the ingestion of data from various relational databases, raw files, HTML pages, and open data into the datalake. ● Enrich the data with external sources of information from Open data (Insee) and other public databases. ● Build automatic scraping processes to collect Web pages with key information from diverse Web applications. ● Develop Python scripts to extract raw texts from over 250k+ PDF, Word, HTML, and image documents (Tika, OCR). ● Propose and implement deterministic (ID) and non-deterministic (Text mining) approaches for data matching from diverse sources. ● Set up an ElasticSearch search engine to index connected data. ● Design and develop collaboratively the Web application to search and explore text documents (React, Django). ● Organize and lead many workshops to manually annotate text documents (Doccano) and build a training set for the NER POC. ● Implement a NER POC (Named Entity Recognition) to automatically extract important information from text documents. ● Organize many user workshops to collect client needs for an effective data search and organization. ● Animate the team and help them to acquire and share IT knowledge and practices. ● Create thorough unit and integration tests (Pytest). ● Write technical documentation.
NLP Scientist | Django - React Developer | Entrepreneur d'Intérêt Général
janv. 2019 - oct. 2019
10 mois
Paris Area, France
Conception et développement de la plateforme de recherche, d’analyse et de visualisation des documents de la Cour des comptes « Plume exploration » Mission : Transformer les métiers des juridictions financières en développant des outils de rédaction collaborative et d’exploration de données https://entrepreneur-interet-general.etalab.gouv.fr/defis/2019/plume.html Design and develop a POC of a search engine based on Elasticsearch and text mining algorithms for the search, exploration and visualisation of text documents produced by la Cour des comptes.
Data Engineer - Scientist | Developer
PagesJaunes SA
nov. 2016 - déc. 2017
1 an 2 mois
Paris Area, France
● Design the data pipeline architectures for 2 new products: 1/ a data visualization application of SoLocal businesses about various information such as their paying or free services, the audience, the statistics on clicks or views, the reviews... ; 2/ a geographic search platform of SoLocal businesses. ● Build and maintain ETL processes for data flowing between databases, Elasticsearch, the data lake, and those applications. ● Set up an Elasticsearch search engine and build and maintain pipelines from data lakes to feed Elasticsearch. ● Improve and optimize the former data pipelines and SQL Stored Procedures. ● Use time series and deep learning techniques to analyze user clicks to predict the future and propose new services to businesses. ● Create thorough unit and integration tests. ● Train 10+ Amadeus employees on Scala.
Head of Research | Scala - React Developer
Stample
sept. 2012 - déc. 2016
4 ans 4 mois
● Develop a knowledge management platform Stample2 using technologies like Play Scala, React, Redux Typescript, and Elasticsearch. ● Develop from scratch a Web application in Scala dedicated to the management of psychologist patients for the Paris area (Qualisocial3). ● Ensures applications' ability to interact with multiple APIs and databases. ● Refactor 2000+ lines of code to migrate an older version of the application from BackboneJS to ReactJS. ● Do peer code reviews. ● Lead all the Research Tax Credit (CIR: Crédit Impôt Recherche) projects. This allowed Stample to get public research funds from 2014 to 2016 and to earn the JEI status (JEI: Jeune Entreprise Innovante). ● Write 3 Research Tax Credit reports with a detailed state-of-the-art and thorough description of all innovative works done by the start-up. ● Develop from scratch a Web application in Scala dedicated to the management of psychologist patients for the Paris area (Qualisocial). ● Supervise one student on Javascript development.
Post Doc
UPMC (Université Pierre et Marie Curie)
févr. 2011 - oct. 2012
1 an 9 mois
Paris Area, France
Many works have studied the Internet topology, but few have investigated the question of how it evolves over time. This paper focuses on the Internet routing IP-level topology and proposes a first step towards realistic modeling of its dynamics. We study periodic measurements of routing trees from a single monitor to a fixed destination set and identify invariant properties of its dynamics. Based on those observations, we then propose a model for the underlying mechanisms of the topology dynamics. Our model remains simple as it only incorporates load-balancing phenomena and routing changes. By extensive simulations, we show that, despite its simplicity, this model effectively captures the observed behaviors, thus providing key insights on relevant mechanisms governing the Internet routing dynamics. Besides, by confronting simulations over different kinds of topology, we also provide insights on which structural properties play a key role to explain the properties of the observed dynamics, which therefore strengthens the relevance of our model. ● Analyze a collection of IP routes collected at different series of times from the Internet. ● Propose novel statistical approaches to model the dynamic of the Internet topology. ● Design and develop a tool, Radarsimulator, to simulate the evolution of the Internet IP topology over time. Radarsimulator performs routing measurements on artificial graphs and generates different views of the graphs in several steps. ● Supervise 2 interns of undergraduate and engineer levels. ● 3 publications on national and International conferences.
Phd student
Lip6
oct. 2007 - mars 2011
3 ans 6 mois
Paris Area, France
My thesis was on developing more sophisticated trouble ticketing systems to ease network management. As a first step, I use information retrieval techniques to automatically analyze trouble tickets. This characterization allows network operators to quickly get statistics on past network incidents and can assist the troubleshooting of new incidents. Then, I analyze the impact of trouble tickets on both intra- and inter-domain routing. ● Build a tool to automatically and periodically scrap trouble tickets from various network operators. ● Design and develop an original tool, Troubleminer, that automatically classifies a collection of trouble tickets from different network operators. Troubleminer uses NLP (Natural Language Processing) and machine learning techniques to select relevant words on text documents, group them into clusters and structure them into a hierarchy. ● Collect and use network alarms to characterize the influence of different types of failures. ● Characterize the influence of different types of failures based on network alarms. ● Propose and implement different machine learning models to classify and predict network failures based on network alarms. ● 3 publications on International conferences.
Formation
Pierre and Marie Curie University
PhD (Doctorat), Computer Science
2007 - 2011
5 ans