Data Engineer

We are looking for Azure Data Engineer

Experience - 4 to 7 years

Location - Bangalore

Work Mode - Hybrid Mode

JD:

We are seeking a highly skilled ETL Data Migration Engineer with 4 to 7 years of experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Build and optimize data transformation processes using Azure Databricks and PySpark.
• Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
• Analyze source-to-target mappings and implement complex business transformation logic.
• Develop reusable data ingestion frameworks and automation solutions.
• Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions.Implement data validation, reconciliation, and data quality checks during migration activities.
• Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements.Support deployment, release management, and CI/CD processes using Azure DevOps.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and ensure adherence to development best practices.
• Create and maintain technical documentation, migration runbooks, and deployment guides.Support Agile ceremonies including Sprint Planning, Daily Scrum, Retrospectives, and Release activities.

Required Technical Skills

Must Have

Azure Data Factory (ADF)

Azure Databricks

• PySpark
• SQL Server / DB2 / Relational Databases
• Python
• Azure DevOps
• ETL/ELT Development
• Data Migration & Data Integration
• Source-to-Target Mapping
• Data Validation and Reconciliation
• CI/CD Pipelines
• Medallion Architecture (Bronze, Silver, Gold)

Key Competencies

• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management skills.
• Ability to work in Agile/Scrum environments.
• Ownership mindset and proactive approach to delivery.
• Ability to mentor junior team members and drive technical excellence.

Thanks & Regards

Kajal Badsiwal

Everforth Quinnox

Email ID - [email protected]