GURUNATHAN VIGNESHWAR

Senior Data Engineer | Apache Airflow

Salaire / Taux journalier

33700 Mérignac, France

Freelance

Peut venir sur site

Expertises

PythonMongoDBETL

Langues

Anglais

À propos

Introduction

Data Engineer with 5+ years building ETL pipelines and clinical data management systems. Expert in Apache Airflow, Python, and MongoDB with proven success in GDPR-compliant data anonymization and real-time dashboards. I deliver scalable data solutions that transform complex datasets into actionable insights for healthcare and enterprise clients.

Liens

Expérience de travail

Data Engineer

IHU LIRYC - Université de Bordeaux

mai 2021 - mai 2025

4 ans 1 mois

33600 Pessac, France

• Served as a Data Engineer for Beat-AF,a European Union-funded project focused on advanced data management for Clinical research in Atrial Fibrillation. • Designed and implemented a web server using Girder (an open-source platform) with Python and MongoDB to manage complex data types, including DICOM, EP signals, and Rhythmia, ensuring scalability and efficiency. • Created scientific visualizations using VTK and developed custom Girder plugins, enabling researchers to interpret complex datasets with enhanced clarity and precision. •Designed a Proof of Concept (PoC) data pipeline using Apache Airflow for anonymizing sensitive clinical data, demonstrating compliance with GDPR and other regulations. •Built an ETL pipeline to extract ECG data from the Kardia Pro API, anonymize it, and load it into a centralized database for further analysis. •Created an interactive dashboard to monitor and visualize ECG data, providing real-time insights and improving data accessibility for clinicians and researchers. •Designed a centralized database by integrating data from diverse sources, streamlining access and improving data reliability. •Conducted data cleaning and quality improvements, ensuring the integrity and usability of clinical datasets. •Developed a dashboard using Pandas to monitor the status of data uploads from clinical centers, enabling real-time tracking and resolution of issues.

Data Engineer

vectoriveFreelance

janv. 2020 - mai 2021

1 an 5 mois

7620 Paris, Danemark

• Registration and Integration of Dynamics 365 App with Azure Active Directory. • Authentication of Apps with Access token using libraries MSAL, ADAL in python. • Extracted CRM data via WEB API and Odata. Data Streaming Pipeline • Create a Streaming Environment with Apache Flink in Python(Pyflink). • Make a Data source from Apache Kafka Producer. • Create a sink on Apache Flink in Python • Perform an ETL (SELECT,AGGREGATE, FLAT MAP ) on Py flink . • Register the Tables on Postgres.

Ad Operation Manager

Jabmo - Industrial-strength Account-based Marketing

févr. 2018 - mars 2019

1 an 2 mois

Paris Area, France

Ad Operation ( Adops) • Creating and Managing Ad Campaigns. • Segmentation of the Targets for Personalized Advertising. • IP and Re Targeting, Sourcing IPs & BVD Id, Creating Segments • Generating Reports, Optimizing the campaigns KPIs (CPM, Bid,) • Troubleshooting Campaigns to improve the performance. Technical Account Management (TAM) • Helping the CSM ( Customer Success Managers) to associate the Target Accounts in the Platform • Exporting the reports from the Platform to identify the Engagement,leads • Help the clients to add Jabmo Tags and Pixels on their website • Helping to resolve clients Technical Problem. • Preparing data files for SFDC import. • Preparation of Marketing Engagement Details from Clients Engagement Dashboard • Importing Marketing Engagement data to a client's salesforce. • Publishing Articles for the clients in the Platform

IT Manager

Jabmo

juil. 2017 - janv. 2019

1 an 7 mois

Paris Area, France

• Management of Assets, Inventory Devices and IT tools. • Controlling and evaluating IT and electronic data operations. • IP Phone, Network configuration, IT Documentation. • Install, configure and maintain software applications and OS.


Formation

DSTI - School of Engineering

Applied MSc in Data Engineering

2019 - 2020

1 an 1 mois

IPAG Business School

Master of Business Administration - MBA

2017 - 2018

1 an 1 mois

kalasalingam university

M.Tech

2011 - 2013

2 ans 1 mois

Mailam Engineering College

Bachelor of Engineering (BEng)

2007 - 2011

4 ans 1 mois

wise man

Higher Secondary

2005 - 2007

2 ans 1 mois

Le meilleur endroit pour trouver votre prochaine opportunité

© 2026. Tous droits réservés.