Azure Databricks

Dear Candidate,

Greetings from the Recruitment Team!

We are currently hiring for a Senior Data Engineer / Azure Databricks opportunity. Please find the requirement details below:

Role: Senior Data Engineer / Azure Databricks Engineer
Experience: 8+ Years
Primary Skills: Databricks, Azure, Data Engineering, Python
Technology: Microsoft Azure / Databricks / Azure Data Lake / Microsoft Fabric

Key Responsibilities

• Design, implement, and manage scalable data solutions on Microsoft Azure.
• Develop and maintain robust data pipelines using Databricks.
• Implement efficient data storage and retrieval using Azure Storage and Azure Data Lake.
• Automate infrastructure and application deployments using Ansible and YAML.
• Develop clean, scalable, and maintainable code using Python.
• Use Git and GitLab for version control and CI/CD.
• Gather and document business requirements through stakeholder discussions and workshops.
• Analyze business requirements and translate them into technical specifications.
• Apply data analytics to interpret data and support data-driven business decisions.
• Collaborate effectively with stakeholders and provide regular project updates.
• Identify opportunities for process improvement and automation.
• Support and mentor junior team members and contribute to wider engineering initiatives.

Essential Skills

• 8+ years of experience in Data Engineering / Data Analysis.
• Strong hands-on experience with Microsoft Azure.
• Hands-on experience with Azure Databricks for data processing and analytics.
• Strong understanding of Azure Storage and Azure Data Lake.
• Knowledge of Microsoft Fabric concepts and best practices.
• Experience designing and implementing Azure Data Lakes.
• Hands-on experience with Ansible and YAML for automation/configuration management.
• Strong programming skills in Python.
• Strong experience with Git and GitLab CI/CD.
• Excellent stakeholder communication and analytical skills.