Commercial Senior Data Engineer

Senior Azure Data Engineer

Job Title: Senior Azure Data Engineer
Job Location: Pimpri, Pune
Work Mode: Hybrid
Employment Type: Contractual
Experience: 36 Years
Job ID: ATCO-15047
Positions: 1
Budget: Up to 15 LPA
Notice Period: Immediate to 30–45 Days

Job Summary

We are looking for a skilled Senior Azure Data Engineer to design, develop, and maintain secure, scalable, and high-performance data solutions on the Azure Data Platform.

The role involves end-to-end ownership of data pipelines, data platforms, architecture, performance optimization, security, and cost optimization. The engineer will work closely with Product Owners, Architects, and stakeholders to deliver reliable and reusable data solutions.

Key Responsibilities

• Design, develop, test, deploy, and maintain end-to-end Azure-based data solutions.
• Build and manage scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Snowflake, and related Azure services.
• Design data engineering architectures aligned with enterprise standards, security, governance, and best practices.
• Develop high-quality, secure, maintainable, and performance-optimized data solutions.
• Implement CI/CD, DevOps, DataOps, Infrastructure as Code, automated testing, monitoring, and release management.
• Troubleshoot complex production issues, identify root causes, and implement permanent solutions.
• Drive performance improvement, reliability, scalability, and cost optimization across data platforms.
• Make independent technical decisions and evaluate trade-offs related to cost, performance, complexity, and risk.
• Define and implement data modelling, coding, CI/CD, monitoring, and documentation standards.
• Mentor junior engineers through technical guidance, design reviews, code reviews, and knowledge sharing.
• Support data quality investigations, access strategies, platform optimization, and other technical requests.
• Ensure data solutions are designed to support analytics, Machine Learning, and Generative AI workloads.

Required Skills

• 3–6 years of experience in Data Engineering / Cloud Data Engineering.
• Strong hands-on experience with Microsoft Azure Data Platform.
• Expertise in Azure Data Factory (ADF).
• Strong experience with Azure Databricks, PySpark, SQL, and Delta Lake.
• Experience with Snowflake and modern data platforms.
• Strong programming experience in Python and SQL.
• Experience with DevOps/DataOps and CI/CD pipelines.
• Hands-on experience with Azure DevOps, Jenkins, Git, or similar tools.
• Understanding of Infrastructure as Code and automated testing.
• Strong knowledge of data pipeline design, data validation, performance testing, monitoring, and production readiness.
• Experience with data security, governance, scalability, and cost optimization.
• Good understanding of Azure AI services, such as Azure Machine Learning, Azure OpenAI, or Cognitive Services.
• Strong analytical, problem-solving, and communication skills.
• Experience working in Agile/Scrum/Kanban and Waterfall environments.

Good to Have

• Experience with Java or .NET.
• Knowledge of SAP BW, MuleSoft, or Apigee.
• Azure Data Engineer or relevant Azure certifications.
• Experience supporting Machine Learning and Generative AI data workloads.
• Experience in mentoring engineers and making architectural decisions.

Key Skills

Azure Data Engineer | Azure Data Factory | ADF | Databricks | PySpark | Python | SQL | Delta Lake | Snowflake | Azure DevOps | CI/CD | DataOps | DevOps | Data Engineering | Azure Cloud | Data Pipelines | Azure AI | Machine Learning | Generative AI

Interview Process

• Round 1: F2F
• Round 2: Technical – Virtual / Face-to-Face
• Round 3: HR

Laptop is mandatory for the interview.