AWS data engineer

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using Scala and Spark on AWS.
• Develop complex SQL queries to optimize database performance and troubleshoot issues.
• Implement data quality checks and ETL processes to ensure accurate data processing.

Desired Candidate Profile

• 6-8 years of experience as a Data Engineer with expertise in Scala, Spark, Hadoop, Oozie, and AWS.
• Strong understanding of big data technologies such as Apache Spark and Hive.
• Proficiency in writing efficient SQL queries for querying large datasets.
• Experience working with cloud-based platforms like Amazon Web Services (AWS).