Lead Data Engineer

Job highlights

• Experience working in Agile / sprints in a global team setup .
• Bachelor s Degree in Computer Science,Data Analytics,Business Management,or IS .
• Minimum 6-9 years of experience in Azure Data Engineering .
• Working experience in writing scripts on C# or similar languages for API development . .

What will you be responsible for

• Strong knowledge of SQL, Azure SQL, TSQL
• Strong knowledge of database, datawarehouse and data analysis
• Strong knowledge of Databricks, python, spark.
• Working experience in writing scripts on C# or similar languages for API development
• Integrate unstructured data from multiple systems to create a single source of truth
• Develop, monitor, and manage report curation and data modeling
• Creating/implementing/Adopting API Governance and Standards for Data Analytics
• Creating APIs to integrate unstructured data from a variety of systems to create a single source of truth (SailPoint, ServiceNow, Project Online, ADO, Intune, Azure licensing, and other systems of records for single/bi-direction data sets)
• Working on Azure Services like Azure Data Factory, Azure Workbook, Log Analytics, Azure Functions, and other data analytics tools
• Leveraging various Azure Services such as Azure Storage, Logic Apps, Data Factory, Azure SQL SaaS, Runbooks, Automation, Graph API, and various other data tools Developing/maintaining microservice automation (Prisma Cloud/Kubernetes)
• Working experience in data visualization, PowerBI, writing complex SQL queries

What would your day look like

• Work closely with service teams to determine project engagement and priority, business data reporting and analysis requirements
• Gather Requirements, Data analysis and modelling
• Create scripts to support enhancements
• Work with external vendors on bi-directional API integrations
• Collaborate with DWH and Reporting teams on data analysis and integrity
• Gather requirements, develop, and implement solutions across all endpoint technologies in the Microsoft stack

Who we are looking for

• Minimum 6-9 years of experience in Azure Data Engineering
• Minimum 6-9 years of experience in BI Development
• 6-9 years of experience working in cloud technologies such as Azure/AWS/Google cloud service
• Experience with Apache Spark and Azure Databricks
• Working knowledge of Microsoft Fabric
• Ability to troubleshoot technical problems, demonstrate problem solving
• Ability to effectively communicate and excellent interpersonal skills
• Experience working in Agile/sprints in a global team setup
• Bachelor s Degree in Computer Science, Data Analytics, Business Management, or IS