Data Engineer

Azure Data Engineer _ London_

Location: London (Onsite – 5 Days/Week) – UK based candidates

Experience: 5–7 Years

About the Role

We are looking for an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions supporting business intelligence, analytics, and data-driven decision-making.

The role will focus on data modeling, data pipeline development, Azure data services, data warehousing, SQL, Python, and Power BI. You will work closely with business stakeholders, data analysts, data scientists, and engineering teams to translate business requirements into reliable and efficient data solutions.

The ideal candidate has strong hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Azure SQL, advanced SQL, and Python, together with a good understanding of data architecture, ETL processes, and data management.

What You’ll Do

• Design and develop scalable, efficient, and reliable data models to support business intelligence and analytics needs.
• Develop and implement architectural strategies for data storage, processing, and retrieval using Azure cloud services.
• Design, develop, and maintain ETL processes to ingest, transform, and load data from various sources into Azure data services.
• Build robust data pipelines using Azure Data Factory (ADF) to ensure smooth data flow and integration between different systems.
• Design, implement, and manage data warehouse / data lakehouse solutions on Azure, ensuring optimal performance, scalability, and cost efficiency.
• Utilize Azure Synapse Analytics to develop, optimize, and manage data warehousing solutions for large-scale data analytics.
• Develop and maintain Python scripts to automate data processing tasks and workflows.
• Design and create interactive Power BI dashboards and reports to enable data-driven decision-making.
• Provide support and training to end users for the effective utilization of data visualization tools.
• Write and optimize complex SQL queries for data extraction, transformation, and loading operations.
• Manage and administer Azure SQL databases, ensuring data integrity, security, and performance.
• Monitor data systems for performance, security, and reliability issues and implement enhancements as required.
• Identify and resolve data-related issues promptly to ensure the smooth operation of data processes.
• Collaborate with business stakeholders to understand data requirements and translate them into technical specifications.
• Work closely with data scientists, analysts, and other engineering teams to deliver comprehensive data solutions.
• Maintain comprehensive documentation for data models, pipelines, and processes to ensure knowledge sharing and continuity.
• Ensure all data solutions comply with organizational policies, industry standards, and regulatory requirements.

Mandatory Skills

• Strong hands-on experience with Azure Data Services, including:
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• Azure Data Lake
• Azure Functions
• Azure Logic Apps
• Azure SQL
• Azure Synapse Dedicated SQL Pool / Data Warehouse
• Azure Key Vault
• Strong experience with Azure DevOps, including understanding of DevOps project flows.
• Advanced SQL skills.
• Strong Python skills.
• Hands-on experience with Power BI.
• Experience with relational databases such as:
• Azure SQL
• MySQL
• MariaDB
• Strong understanding of data modeling, ETL processes, data warehousing, and data pipelines.
• Good understanding of data security, performance optimization, monitoring, and troubleshooting.
• Strong collaboration and communication skills.

Nice to Have

• Experience with CI/CD pipelines.
• Experience implementing CI/CD for data engineering solutions using Azure DevOps.
• Experience with automated testing and deployment of data engineering solutions.

If interested to hear more about this role, please send your CV to [email protected] with the best contact details to get connected for a quick discussion on the same.

Regards,

Mary Priscilina