AWS Data Engineer (Redshift | PySpark | SQL)

About Durapid Technologies Durapid Technologies is a Microsoft Data & AI Solutions Partner and Databricks partner delivering Data Engineering, AI/ML, and Enterprise Software solutions to clients across India, the USA, the UK, the Middle East, and Singapore.

About The Role We’re looking for an AWS Data Engineer with 5+ years of experience strong hands-on expertise in PySpark, SQL, and AWS Redshift to design, build, and optimize scalable data pipelines and cloud data platforms. You’ll work closely with data architects, data scientists, analysts, and business stakeholders to deliver reliable, high-performance data solutions for analytics, reporting, and AI/ML initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and AWS services
• Build and optimize ETL/ELT workflows for structured and unstructured data
• Develop and manage enterprise data warehouses on AWS Redshift
• Write complex, optimized SQL for extraction, transformation, and analysis
• Ingest data from APIs, databases, flat files, and streaming sources
• Perform data cleansing, validation, and quality checks
• Tune Redshift schemas, tables, and queries for performance and scale
• Apply data governance, security, and compliance best practices
• Monitor, troubleshoot, and resolve pipeline and performance issues
• Support production deployments and maintain technical documentation

Must-Have Skills

• AWS Redshift (hands-on, mandatory)
• Strong PySpark and advanced SQL with performance optimization
• AWS S3 and AWS Glue
• ETL/ELT pipeline development, data modeling, and data warehousing
• Willingness to work from the Chennai office 5 days a week

Good-to-Have Skills

• AWS Lambda, IAM, CloudWatch, Step Functions, Secrets Manager
• PostgreSQL, MySQL; SQL Server
• Git/GitHub/Bitbucket, CI/CD, Shell and Python scripting
• Data Lake / Lakehouse architecture; Databricks or Amazon EMR
• Apache Airflow / MWAA, Kafka or real-time streaming
• Terraform or CloudFormation
• Snowflake or other cloud data warehouses
• Experience supporting BI, analytics, or ML workloads

Qualifications

• Bachelor’s or Master’s in Computer Science, Engineering, IT, or a related field
• 5+ years in Data Engineering, preferably on AWS
• Proven track record building large-scale pipelines and warehouse solutions
• Strong problem-solving, communication, and stakeholder management skills

Skills: data,data engineering,aws