Azure Data Engineer ADF

Develops and maintains scalable Azure Data Factory (ADF) data pipelines and/or builds out new API integrations to support continuing increases in data volume and complexity across our source data systems.

Collaborates with data modelers, data scientists, business analysts and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Writes unit/integration tests and documents work.

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Designs data integrations and data quality framework.

REQUIREMENTS: -

Experience designing, building, and deploying scalable Azure cloud-based solution architectures.

Minimum 5+ years of relevant hands-on experience in Data Ingestion, Integration and Transformation

Strong working knowledge of ETL, BI, Data Lake and Data warehousing tools and technologies

Strong experience with data systems and infrastructure on Azure, especially Azure Data Factory (ADF)

Knowledge of Azure Synapse Analytics, Azure Data Lake, Azure SQL, Azure Databricks or equivalent tools and technologies

Strong Expertise in SQL and Python

Knowledge of streaming mechanisms

Experience with error exception handling mechanisms, monitoring and alerting techniques

Knowledge of Azure DevOps, or Continuous Integration/Delivery

Experience with FiveTran for SalesForce Integration

Knowledge of containerization and container orchestration technologies.

Familiarity with standard IT security practices such as identity and access management, SSO, data protection, encryption, certificate, and key management

Perform data analysis to support strategic initiatives and clearly communicate and present insights to leadership.

Strong analytical problem-solving skills

Excellent written and verbal communication skills.