Data Engineer ( Senior )

Job highlights

• Prior experience in working on AWS EMR,Apache Airflow . Certifications - AWS Certified Big Data Specialty Cloudera or Hortonworks Certified Big Data Engineer . Understanding of DataOps Engineering .
• 4 to 7 years of experience in Apache Spark

What you will do?

• Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam.

• Explore new technologies and learn new techniques to solve business problems creatively.

• Collaborate with many teams - engineering and business, to build better data products and services.

• Deliver the projects along with the team collaboratively and manage updates to customers on time.

What are we looking for?

• 4 to 7 years of experience in Apache Spark.

• 2+ years of experience in writing ETL jobs using pySpark, and SparkSQL

• 2+ years of experience in SQL queries and stored procedures

• Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+

You are preferred if you have

• Prior experience in working on AWS EMR, Apache Airflow

• Certifications - AWS Certified Big Data Specialty Cloudera or Hortonworks Certified Big Data Engineer

• Understanding of DataOps Engineering