AWS Data Engineer - AWS Glue

AWS Glue / Databricks Data Engineer

We are looking for an experienced Data Engineer with strong hands-on expertise in AWS Glue and Databricks to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities:

• Develop and maintain scalable ETL /ELT pipelines using AWS Glue, Databricks, and PySpark.
• Build data ingestion and transformation workflows using Python and SQL.
• Work with AWS S3, Data Lake, Spark, and Delta Lake for large-scale data processing.
• Optimize data pipelines for performance, scalability, reliability, and cost.
• Perform data validation, troubleshooting, and production support.
• Collaborate with data architects, analysts, and other engineering teams to deliver data solutions.
• Follow best practices for data quality, security, monitoring, and deployment.

Required Skills:

• Strong hands-on experience with AWS Glue and Databricks.
• Good experience with PySpark, Python, and SQL.
• Strong understanding of Apache Spark and distributed data processing.
• Experience with AWS S3 and cloud-based data lakes.
• Experience developing and supporting production-grade data pipelines.
• Knowledge of Delta Lake and data warehousing concepts is preferred.
• Familiarity with Git, CI/CD, and Agile methodologies is a plus.

Primary Skills: AWS Glue, Databricks, PySpark, Python, SQL, AWS S3, Apache Spark