Azure Databrick Lead

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Databricks.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Develop complex SQL queries to optimize database performance and troubleshoot issues.
• Implement machine learning models using PySpark on Spark clusters.
• Ensure seamless integration of Azure services such as Data Factory, Synapse Analytics, and Logic Apps.

Desired Candidate Profile

• 6-11 years of experience in designing and developing big data solutions using Azure Databricks.
• Strong expertise in working with PySpark on Spark clusters.
• Proficiency in writing complex SQL queries for query optimization and troubleshooting purposes.
• Experience with implementing machine learning models using PySpark is an added advantage.