Senior Data Engineer

Role & responsibilities

We are seeking an experienced Senior Data Engineer to support a strategic SAP HANA to Snowflake Data Platform Modernization initiative. The ideal candidate should possess strong expertise in cloud data engineering, ELT/ETL pipeline development, data modeling, and Snowflake architecture. The Senior Data Engineer will be responsible for designing and validating scalable data ingestion and transformation frameworks, building proof-of-concept pipelines, establishing cloud-native engineering patterns, and collaborating with Data Architects, SAP HANA SMEs, BI teams, and business stakeholders to deliver a robust migration strategy. The role requires hands-on experience in designing enterprise data platforms using modern cloud technologies and Medallion Architecture.

Key Responsibilities

• Design and develop scalable ELT/ETL pipelines to migrate data from SAP HANA to Snowflake.

• Build Proof of Concepts (PoCs) to validate migration approaches, performance, and scalability.

• Design and implement Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.

• Develop historical and incremental data loading frameworks using Change Data Capture (CDC) strategies.

• Create reusable transformation logic using SQL, Python, PySpark, and dbt.

• Design and optimize Snowflake objects including databases, schemas, virtual warehouses, stages, streams, tasks, and Snowpipe.

• Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) and dimensional modeling techniques.

• Perform data profiling, data validation, reconciliation, and quality assessments.

• Optimize SQL queries, ELT processes, and Snowflake compute/storage usage for performance and cost efficiency.

• Evaluate and recommend data ingestion and orchestration tools such as dbt, Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.

• Collaborate with Data Architects and SAP HANA SMEs to define source-to-target mappings and transformation strategies.

• Produce technical design documents, engineering standards, and implementation guidelines.

• Mentor Data Engineers and participate in architecture reviews, code reviews, and Agile ceremonies.

Required Skills

• Strong experience in Snowflake architecture, SQL, Snowpipe, Streams & Tasks, Virtual Warehouses, and performance optimization.
• Hands-on expertise in SQL, Python, and PySpark for building scalable data pipelines.
• Experience in ETL/ELT development, data transformation, and Change Data Capture (CDC).
• Proficiency with dbt and exposure to tools such as Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.
• Strong understanding of Medallion Architecture, dimensional data modeling, and SCD Type 1 & Type 2.
• Experience working with SAP HANA and migrating data to cloud data platforms such as Snowflake.
• Knowledge of cloud platforms (AWS, Azure, or GCP) and cloud storage services.
• Familiarity with Git, Azure DevOps, Jira, and Confluence.
• Excellent analytical, problem-solving, communication, and stakeholder collaboration skills.

Preferred Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• Experience implementing enterprise-scale Snowflake solutions.
• SnowPro Core Certification or equivalent is preferred.
• Cloud certification (AWS, Azure, or GCP) is an added advantage.
• Experience working in Agile/Scrum environments.

Nice to Have

• Experience with Snowpark.

• Knowledge of AI/ML data engineering concepts.

• Exposure to Large Language Models (LLMs), Prompt Engineering, or Retrieval Augmented Generation (RAG). •

Experience implementing DataOps or CI/CD pipelines for data platforms.

• Experience working with globally distributed teams.