Data Engineer

Job Summary We are seeking a skilled Azure Data Engineer to join our Data Engineering team. The successful candidate will design, develop, maintain, and support enterprise-scale, metadata-driven Azure Data Factory (ADF) solutions. The role involves integrating data from SQL Server, Salesforce, REST APIs, and other enterprise applications into Azure Data Lake Storage Gen2 and Azure Blob Storage while ensuring secure, scalable, and high-performance data movement. The engineer will work closely with business stakeholders, data analysts, QA teams, and data scientists to design robust ETL/ELT solutions, implement best practices for data quality, and support production environments. The ideal candidate should have strong experience in Azure services, production support, Azure DevOps CI/CD, Power BI reporting, Agile delivery, and secure cloud data engineering. Key Responsibilities Design, develop, and maintain enterprise Azure Data Factory (ADF) pipelines. Build metadata-driven ETL/ELT frameworks supporting multiple source systems. Acquire, ingest, validate, and process data from SQL Server, Salesforce, REST APIs, JSON, CSV, and Parquet. Develop secure and scalable data integration solutions using ADLS Gen2 and Azure Blob Storage. Monitor production pipelines, troubleshoot failures, analyze logs, and resolve incidents within SLA. Implement data quality validations, reconciliation, and error handling. Create Power BI reports and operational dashboards. Develop Azure Logic Apps for workflow automation and notifications. Deploy Azure artifacts using Azure DevOps CI/CD. Collaborate with business users, QA, data scientists, and developers. Participate in Agile ceremonies and maintain technical documentation. Required Technical Skills Azure Data Factory (ADF) Metadata-driven ETL/ELT Pipelines SQL Server, T-SQL, Stored Procedures, Views, Performance Tuning Azure Data Lake Storage Gen2 & Azure Blob Storage Azure Monitor, Log Analytics Azure DevOps (Repos, Branching, PRs, CI/CD) Power BI Reports & Dashboards Azure Logic Apps Strong understanding of Information Security and SDLC Preferred Skills Python scripting Salesforce Integration REST APIs Azure Key Vault & Managed Identity JSON, CSV, Parquet Databricks/PySpark (good to have) Qualifications & Experience 5+ years in Azure Data Engineering or similar role. Experience delivering enterprise-scale Azure Data Platform solutions. Hands-on production support and performance optimization. Strong client communication, collaboration, and consulting mindset. Knowledge of Data Warehousing, Data Quality, and dimensional modeling.

Required Skills

Design, develop, and maintain enterprise Azure Data Factory (ADF) pipelines. Build metadata-driven ETL/ELT frameworks supporting multiple source systems. Acquire, ingest, validate, and process data from SQL Server, Salesforce, REST APIs, JSON, CSV, and Parquet. Develop secure and scalable data integration solutions using ADLS Gen2 and Azure Blob Storage. Monitor production pipelines, troubleshoot failures, analyze logs, and resolve incidents within SLA. Implement data quality validations, reconciliation, and error handling. Create Power BI reports and operational dashboards. Develop Azure Logic Apps for workflow automation and notifications. Deploy Azure artifacts using Azure DevOps CI/CD. Collaborate with business users, QA, data scientists, and developers. Participate in Agile ceremonies and maintain technical documentation. Required Technical Skills Azure Data Factory (ADF) Metadata-driven ETL/ELT Pipelines SQL Server, T-SQL, Stored Procedures, Views, Performance Tuning Azure Data Lake Storage Gen2 & Azure Blob Storage Azure Monitor, Log Analytics Azure DevOps (Repos, Branching, PRs, CI/CD) Power BI Reports & Dashboards Azure Logic Apps Strong understanding of Information Security and SDLC Preferred Skills Python scripting Salesforce Integration REST APIs Azure Key Vault & Managed Identity JSON, CSV, Parquet Databricks/PySpark (good to have)