Specialist Data Engineer (ETL Expert)

Job Summary

The Data Science Centre at KGMU aims to serve as a multidisciplinary hub for transforming health data into actionable insights to improve patient outcomes, enable data-driven research, and support policy decision-making at the institutional and state levels.

The role holder should design, develop, and optimize ETL pipelines for seamless data integration from multiple sources into the data warehouse/analytics systems. The role holder should ensure data accuracy, integrity, and performance across integrated systems, and collaborate with data teams to enable seamless data availability for analytics and AI models.

Travel Requirements

10%-20%

Reporting to

Nodals of Data Science Centre, KGMU

Key Responsibilities

• Design and develop robust ETL processes on cloud technology such as AWS to ensure seamless data injestion, data integration and business intelligence.
• Leverage AWS serverless technologies (like Glue / Lambda / Kinesis) for real-time and batch processing of big data.
• Optimize SQL to write complex queries and stored procedures for efficient data extraction and transformation.
• Implement and manage ETL processes using SSIS (SQL Server Integration Services) to guarantee high-quality data delivery.
• Design and model data warehouses to cater to reporting and analytics needs.
• Ensure data accuracy, quality, integrity, and performance of pipelines through effective validation testing procedures.
• Collaborate with business analysts, data scientists, and stakeholders to understand data requirements and deliver tailored solutions.
• Monitor and troubleshoot ETL processes to optimize performance and resolve issues promptly.
• Document ETL processes, meta data, workflows, and data mappings to maintain clarity and usability.
• Develop synthetic data using GenAI.
• Stay current with industry trends and best practices in ETL development, data integration, and data warehousing.
• Knowledge dissemination responsibilities include effectively communicating complex findings to both technical and non-technical audiences, sharing insights through presentations, reports, paper publications, and visualizations, and mentoring junior team members.

Experience

• At least 5 years of experience in the IT sector, including a minimum of 3 years of hands-on experience in ETL development
• Experience in data warehousing designs and modeling
• Experience in handling medical information systems, patient data systems, or healthcare data projects is desirable.

Education

• B.Tech/Master s/PhD in Data Engineering, Computer Science, or IT

Key Competencies

• Proficiency in API, SQL, SSIS, AWS Glue / Talend / Apache Airflow and the likes.
• Knowledge of Microsoft s Azure cloud suite, including Data Factory, Data Storage, Blob Storage, Power BI, and Power Automate.
• Strong problem-solving and analytical skills for data pipeline optimization.
• Strong attention to detail and commitment to data quality.
• Strong oral communication skills.

Location

Lucknow, Uttar Pradesh

Job Type

Full Time

Other Vacancies

• Associate/Specialist Supply Chain - Lucknow, Uttar Pradesh
  Type of contract: Full Time
• Associate/Specialist PPP contract Management - Lucknow, Uttar Pradesh
  Type of contract: Full Time

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.