Senior Data Engineer-Snowflake+DBT

Role & responsibilities

On a typical day, you might

• Collaborate with the clients to understand the overall requirements
• Create a robust, extensible architecture to meet the client/business requirements
• Translate the Business requirements into technical artifacts
• Identify the right technology stack and tools that best meet the client requirements
• Design end to end solutions along with data strategy, including standards, principles, data sources, storage, pipelines, data flow, and data security policies
• Collaborate with data engineers, data scientists, and other stakeholders to execute the data strategy
• Perform data analysis to understand the relevant data sets
• Design and create Data Models to cater to all the requirements
• Identify and implement the right orchestration tool
• Define the right security and access policies
• Implement the Snowflake best practices
• Define the right data distribution/consumption pattern for downstream systems and consumers
• Perform the code reviews and ensure quality deliverables
• Work with DevOps team to define and establish CI/CD process
• Own end-to-end delivery of the project
• Work closely with the clients during UAT Testing and ensure all client issues/concerns are addressed
• Proactively identify the performance bottlenecks and propose corrective actions
• Design and Develop reusable frameworks
• Work with the Project Managers to prioritize work for each sprint to meet project milestones and deadlines
• Closely monitor the Project progress and provide regular updates to the leadership teams on the milestones, impediments etc
• Guide /mentor team members, and create the technical artifacts
• Demonstrate thought leadership.

Preferred candidate profile

• 6-15 years of relevant experience.
• Work from our Chennai (white space) office all 5 days a week to handle sensitive data
• Experience in Snowpro/ Python/ Pyspark
• Decent experience in migration projects, migrating from  On-prem to Snowflake
• Comprehensive knowledge of the Snowflake capabilities such as Snow pipe, SnowSQL, Streams, and Snowflake architecture and awareness of Snowflake roles and user security.
• In-depth knowledge and experience in data migration from RDBMS to Snowflake cloud data warehouse
• Well-versed with Incremental extraction loads - batched and streaming
• Experience with Azure, AWS, or GCP
• Ability to architect data architecture solutions that are in alignment with the strategic technology roadmap and emerging industry trends
• Strong exposure to Data Modelling, Data Access Patterns, and SQL
• Knowledge of  Cost Management, Infrastructure Planning & Disaster Recovery
• Good experience in Data Governance and a good understanding of DevOps practices
• Understanding of Data Virtualization
• Experience in working in Big Data Platform
• Ability to work closely with cross-functional teams
• Excellent communication (verbal and written) and excellent interpersonal skills