Data Engineer (Azure)

Role: Data Engineer

Contract

Work Arrangement: Hybrid (4 days/week onsite): Work Hours: 9:00 AM - 5:00 PM

Experience Required: 6-8 Years

Role Description Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks.

Essential Skills Azure Data Factory (ADF)

Azure Databricks (ADB)

PySpark

SQL

Architecting ETL Frameworks

Required Skills Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners

Strong ability to break down technical requirements into actionable tasks

Proficient with relational databases such as MS SQL and SQL scripting

Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration

Good OOP understanding with experience in Python or Java

Proficiency with Git (Bitbucket or GitHub)

Good understanding of CI/CD concepts for building and deploying artifacts

Understanding of synchronous and asynchronous data encryption/decryption

Nice To Have Skills Azure Databricks Notebooks or Apache Spark for data transformations

Datadog dashboard and monitoring experience

Azure Data Lake Gen2

Understanding of Parquet and Delta Lake concepts

Experience with XLR for CI/CD

Experience with Flyway for data migrations