Consultant – Data Engineer (Azure, Snowflake, dbt)

Coherent Pixel Systems is Hiring!

Consultant – Data Engineer (Azure, Snowflake, dbt)

Experience: 6–12 Years
Location: Chennai, India
Work Mode: Hybrid – 3 Days WFO / Week – DLF, Porur
Shift: 12:00 PM – 9:00 PM IST

Job Description

We are looking for an experienced Data Engineer responsible for the hands-on development, maintenance, and optimization of robust end-to-end analytics data pipelines.

The role involves working with a modern cloud technology stack including Azure, Snowflake, and dbt to ingest and transform data according to Data Vault 2.0 standards, while actively leveraging AI-assisted development tools to improve coding efficiency and delivery speed.

Tools & Technologies

Snowflake | dbt | Azure Data Factory | ADLS | SQL | Python | Git | CI/CD | AI-Assisted Coding Tools

Responsibilities

• Build and maintain scalable, automated data ingestion and processing pipelines using Azure, dbt, and Snowflake.
• Extract data from various source systems and load it into Snowflake for further processing.
• Develop modular and testable SQL transformations using dbt.
• Implement physical Data Vault 2.0 structures, including:
• Hubs
• Links
• Satellites
• Actively use AI coding assistants such as GitHub Copilot / Cursor to:
• Generate boilerplate code
• Write dbt tests
• Draft technical documentation
• Troubleshoot SQL/Python scripts
• Ensure high data quality by developing comprehensive dbt tests and automated data validation checks across the E2E architecture.
• Work closely with the Tech Lead, Data Architect, and Business Analysts in an Agile environment.
• Understand business and technical requirements and deliver reliable datasets for downstream reporting.

Typical Activities

• Write and optimize complex SQL queries and Python scripts for data extraction and transformation.
• Configure Azure Data Factory pipelines and Snowpark Python pipelines for secure and scheduled data movement.
• Develop dbt models, macros, and tests to populate the Snowflake Data Vault.
• Participate in daily Scrum meetings.
• Participate in code reviews with the Tech Lead.
• Troubleshoot and optimize data pipelines and SQL transformations.

Requirements

• 6–12 years of hands-on experience in Data Engineering or Database Development.
• Strong proficiency in writing complex and optimized SQL.
• Solid scripting skills in Python.
• Hands-on experience building pipelines using Microsoft Azure, particularly:
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Practical experience developing and performance-tuning in Snowflake.
• Hands-on experience using dbt for:
• Data transformation
• Testing
• Documentation
• Familiarity with incorporating AI-assisted development tools such as GitHub Copilot into daily coding workflows.
• Understanding of Data Vault 2.0 concepts, including Hubs, Links, and Satellites, and experience populating these structures.

Nice to Have

• Microsoft Certified: Azure Data Engineer Associate
• SnowPro Core Certification
• Experience with CI/CD pipelines using Azure DevOps or GitHub Actions.
• Strong knowledge of Git/version control.
• Exposure to building dimensional models / Star Schemas on top of a Data Vault architecture.

Interested candidates can share their updated resumes.

[email protected]
[email protected]

Contact / WhatsApp:

9840125754 / 9840126408

Work Location: In person