Senior Data Engineer - Snowflake, Cortex & AWS Glue

Position: Senior Data Engineer - Snowflake, Cortex & AWS Glue

Purpose of the Position: To design, develop, and maintain scalable data pipelines and models in Snowflake for retail operations, enabling accurate reporting and analytics across customer, sales, inventory, and workforce domains.

Location: Pune/ Bangalore/Chennai/ Nagpur

Key Result Areas and Activities:

• Data Pipeline Development: Integrate data from different sources like MMS, CRM, Workday, Courion, and other sources via S3 files, APIs, or direct staging in Snowflake.
• ETL Development: Build and optimize ETL workflows using Talend , AWS Glue and SQL stored procedures.
• Data Modeling: Create and maintain Snowflake tables and layered views for business consumption.
• Collaboration: Work closely with data analysts, business stakeholders, and regulatory teams to understand data needs and deliver solutions.
• Performance Optimization: Ensure efficient query performance and cost-effective data processing in Snowflake.
• Documentation & Governance: Maintain clear documentation of data models, transformations, and lineage to support audit and compliance requirements.

Roles and Responsibilities

Essential Skills

• Strong hands-on experience with Snowflake (data warehousing, performance tuning, security).
• Strong SQL skills with stored procedure development.
• Solid understanding of SQL and advanced query optimization techniques.
• Strong experience in Python development for data engineering, automation, and ETL/ELT pipeline development.
• Hands-on experience in designing, developing, and maintaining AWS Glue pipelines, including Glue Jobs, Crawlers, Data Catalog, and workflow orchestration.
• Experience building scalable data integration and transformation solutions using AWS services such as S3, Glue, Lambda, and Step Functions.
• Familiarity with version control (Git) and CI/CD workflows.
• Experience with cloud platforms (AWS, Azure, or GCP), with strong preference for AWS.
• Knowledge of data pipeline monitoring, performance optimization, and troubleshooting in cloud-based data environments.

Desirable Skills

• Exposure/working knowledge
• Understanding of retail data structures (sales, customer, product, workforce).
• Experience with API-based data ingestion.

Qualification:

• Experience: 5+ years in data engineering, with at least 2 years in Snowflake.
• Education: Bachelor's or master's degree in computer science, Data Science, Bioinformatics, or related field.

Qualities:

• Strong analytical and problem-solving mindset.
• Detail-oriented with a focus on data accuracy and compliance.
• Excellent communication and stakeholder management skills.
• Ability to work independently and collaboratively in cross-functional teams.
• Adaptability to fast-paced and regulated environments.