Data Engineer

Job Description: Data Engineer (AWS & Snowflake)

Role Overview

We are seeking an experienced Data Engineer to design, develop, and support scalable cloud-based data platforms and integration solutions. The ideal candidate will have strong expertise in AWS serverless technologies, Snowflake, Terraform, Python, and DevOps practices, with experience building end-to-end data pipelines, API integrations, and cloud-native data platforms.

The role involves working closely with business stakeholders, solution architects, and analytics teams to deliver robust, secure, and scalable data solutions.

Key Responsibilities

Data Engineering & Integration

• Design, develop, and maintain scalable data pipelines and ingestion frameworks.
• Build end-to-end integrations from external APIs into AWS and Snowflake.
• Develop and optimize ELT/ETL processes for structured and semi-structured data (JSON, CSV, XML).
• Implement data quality, validation, monitoring, and reconciliation processes.
• Design and maintain data models for reporting, analytics, and customer data platforms.

AWS Cloud Development

• Develop serverless solutions using AWS Lambda.
• Build and maintain API integrations using AWS API Gateway.
• Design event-driven architectures using AWS EventBridge.
• Develop containerized workloads using AWS Fargate/ECS where appropriate.
• Manage data landing zones and storage solutions using Amazon S3.
• Configure and maintain secure cloud networking and IAM permissions.

Snowflake Development

• Build and maintain Snowflake databases, schemas, stages, tasks, and streams.
• Design scalable data architectures and dimensional models.
• Develop and optimize Snowflake SQL transformations and data pipelines.
• Monitor and optimize Snowflake performance and cost efficiency.

Infrastructure as Code & DevOps

• Develop and maintain infrastructure using Terraform.
• Create reusable Terraform modules for AWS and Snowflake resources.
• Build CI/CD pipelines and deployment automation.

Automation & Monitoring

• Develop operational monitoring, alerting, and dashboard solutions.
• Automate administrative and support activities where possible.
• Troubleshoot production incidents and perform root cause analysis.
• Support business-critical BAU processes and operational data platforms.

Required Skills & Experience

Cloud & AWS

• AWS Lambda
• AWS API Gateway
• AWS EventBridge
• AWS Fargate / ECS
• Amazon S3
• AWS IAM
• CloudWatch
• SNS/SQS
• AWS DevOps services

Programming & Automation

• Python
• REST APIs

Infrastructure & DevOps

• Terraform
• Git/GitHub
• CI/CD Pipelines
• Infrastructure as Code (IaC)

Experience Required

• 3+ years of Data Engineering experience.
• 3+ years working with AWS cloud services. Role & responsibilities

Preferred candidate profile

Perks and benefits