
GURUNATHAN VIGNESHWAR
Senior Data Engineer | Apache Airflow
Salaire / Taux journalier
33700 Mérignac, France
Freelance
Peut venir sur site
Expertises
Langues
À propos
Introduction
Data Engineer with 5+ years building ETL pipelines and clinical data management systems. Expert in Apache Airflow, Python, and MongoDB with proven success in GDPR-compliant data anonymization and real-time dashboards. I deliver scalable data solutions that transform complex datasets into actionable insights for healthcare and enterprise clients.
Expérience de travail
Data Engineer
IHU LIRYC - Université de Bordeaux
mai 2021 - mai 2025
4 ans 1 mois
33600 Pessac, France
• Served as a Data Engineer for Beat-AF,a European Union-funded project focused on advanced data management for Clinical research in Atrial Fibrillation. • Designed and implemented a web server using Girder (an open-source platform) with Python and MongoDB to manage complex data types, including DICOM, EP signals, and Rhythmia, ensuring scalability and efficiency. • Created scientific visualizations using VTK and developed custom Girder plugins, enabling researchers to interpret complex datasets with enhanced clarity and precision. •Designed a Proof of Concept (PoC) data pipeline using Apache Airflow for anonymizing sensitive clinical data, demonstrating compliance with GDPR and other regulations. •Built an ETL pipeline to extract ECG data from the Kardia Pro API, anonymize it, and load it into a centralized database for further analysis. •Created an interactive dashboard to monitor and visualize ECG data, providing real-time insights and improving data accessibility for clinicians and researchers. •Designed a centralized database by integrating data from diverse sources, streamlining access and improving data reliability. •Conducted data cleaning and quality improvements, ensuring the integrity and usability of clinical datasets. •Developed a dashboard using Pandas to monitor the status of data uploads from clinical centers, enabling real-time tracking and resolution of issues.
Data Engineer
vectoriveFreelance
janv. 2020 - mai 2021
1 an 5 mois
7620 Paris, Danemark
• Registration and Integration of Dynamics 365 App with Azure Active Directory. • Authentication of Apps with Access token using libraries MSAL, ADAL in python. • Extracted CRM data via WEB API and Odata. Data Streaming Pipeline • Create a Streaming Environment with Apache Flink in Python(Pyflink). • Make a Data source from Apache Kafka Producer. • Create a sink on Apache Flink in Python • Perform an ETL (SELECT,AGGREGATE, FLAT MAP ) on Py flink . • Register the Tables on Postgres.
Ad Operation Manager
Jabmo - Industrial-strength Account-based Marketing
févr. 2018 - mars 2019
1 an 2 mois
Paris Area, France
Ad Operation ( Adops) • Creating and Managing Ad Campaigns. • Segmentation of the Targets for Personalized Advertising. • IP and Re Targeting, Sourcing IPs & BVD Id, Creating Segments • Generating Reports, Optimizing the campaigns KPIs (CPM, Bid,) • Troubleshooting Campaigns to improve the performance. Technical Account Management (TAM) • Helping the CSM ( Customer Success Managers) to associate the Target Accounts in the Platform • Exporting the reports from the Platform to identify the Engagement,leads • Help the clients to add Jabmo Tags and Pixels on their website • Helping to resolve clients Technical Problem. • Preparing data files for SFDC import. • Preparation of Marketing Engagement Details from Clients Engagement Dashboard • Importing Marketing Engagement data to a client's salesforce. • Publishing Articles for the clients in the Platform
IT Manager
Jabmo
juil. 2017 - janv. 2019
1 an 7 mois
Paris Area, France
• Management of Assets, Inventory Devices and IT tools. • Controlling and evaluating IT and electronic data operations. • IP Phone, Network configuration, IT Documentation. • Install, configure and maintain software applications and OS.
Formation
DSTI - School of Engineering
Applied MSc in Data Engineering
2019 - 2020
1 an 1 mois
IPAG Business School
Master of Business Administration - MBA
2017 - 2018
1 an 1 mois
kalasalingam university
M.Tech
2011 - 2013
2 ans 1 mois
Mailam Engineering College
Bachelor of Engineering (BEng)
2007 - 2011
4 ans 1 mois
wise man
Higher Secondary
2005 - 2007
2 ans 1 mois