Azure Data Engineer

Required Skills:

• 4+ years of experience in Business Intelligence, Data & Report Engineering, or related roles.

• Hands on experience in Spark engineering, PySpark, Spark SQL, KQL, Spark performance optimization is expected from candidate.

• Hands-on experience in DevOps, CI/CD

• Good experience in applications hosted on Azure (Azure hands on Engineering applications is preferred)

• Candidate should have experience in Fabric workload Operations

• Excellent oral and written communication skills with ability to independently engage all stakeholders onsite and offshore

• Knowledge in Spark engineering - someone who has worked on data bricks, Fabric, Databricks,  Spark application engineering.

• Skilled with data analysis, data visualization and reporting & analytics.

• Strong understanding of SDLC and engineering operations practices.

• Experience in Agile/Scrum methodologies and project management tools such as Jira.

• Strong prioritizing, interpersonal, problem-solving, task management (from conception to completion), & planning skills.

• Certifications in relevant BI and cloud technologies (preferably Azure) are a plus.

Desired Skills (Good To Have):

• Experience in Medallion architecture

• Knowledge in Microsoft Fabric, PowerBI, Azure services including Microsoft Fabric, Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.

• Key skills - Framework development, DataOps, Platform engineering & automation

• Candidate with experience in AI with Automation and Data agents

• Knowledge of Databricks

• Data modeling (Native HANA), TDV, SQL Scripting

• Experience of ETL tools, preferably Talend

Responsibilities:

• Responsible for Fabric, PowerBI migrations, Support and Engineering tasks

• Understand design, relational and non-relational data stores on Azure.

• Responsible for problem, Incident management in Microsoft Fabric, PowerBI, Azure big data frameworks/tools: Azure Data Lake, Azure Data Factory, Azure Data Bricks, Synapse, SQL Server, HDInsight.

• Gather and process raw data at scale that meet functional / non-functional business requirements.

• Candidate should be able to present design, analyze problems and Issues and provide insights to leadership

• Responsible for developing data set processes for data modeling, mining and production.

• Responsible for building reusable models using Power BI Datasets and visualizations in Power BI.

• Responsible for maintaining ADLS operations.

• Responsible for enforcement of governance & security across MS Fabric and Azure landscape.

• Responsible for cost analysis and optimization of Azure resources used in BI Landscape and for designing governance solutions to make sure that the resources are used in an optimal and cost-effective manner.

• Responsible for supporting our Software Developers, Data Analysts and Data Scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

• Develop complex SQL queries in Azure SQL.

Education

• IT Graduate (BE, BTech, MCA) preferred.

• Experience of working in Captive is a plus.