Data Engineer

Data Engineer

Location: Bangalore

Experience: 5–8 Years

Budget: ₹22 LPA

No. of Positions: 1

Role Overview

Seeking an experienced Data Engineer to build, optimize, and support scalable, production-grade data pipelines and enterprise data platforms using AWS, Snowflake, Spark/PySpark, Python, SQL, and Airflow/Astronomer.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines and enterprise data products.

Build batch, streaming, and distributed data processing solutions using Spark/PySpark, Python, and SQL.

Develop and optimize data solutions on AWS and Snowflake, including query performance and cost optimization.

Implement workflow orchestration using Airflow/Astronomer.

Ensure data quality, governance, security, lineage, monitoring, and platform reliability.

Support CI/CD, automated testing, DataOps, and AI-ready data platform initiatives.

Mandatory Skills

Strong hands-on experience in Data Engineering, ETL/ELT, and data pipeline development.

AWS, Snowflake, Spark/PySpark, Python, and SQL.

Airflow/Astronomer for workflow orchestration.

Data modeling, data warehousing, lakehouse architecture, and distributed data processing.

Data quality, security, governance, metadata management, and performance optimization.

Git, CI/CD, Infrastructure as Code (IaC), automated testing, and DataOps.

Experience delivering and supporting production-grade data platforms and business-critical data products.

Good to Have

Kafka, event-driven architecture, and real-time data processing.

GenAI, Agentic AI, LLMs, MCP, RAG, and AI-ready data architecture.

Semantic layers, Power BI, self-service analytics, APIs, and microservices.

Retail, eCommerce, supply chain, inventory management, or customer analytics experience.

Education

Required: Bachelor's degree in Engineering or a related discipline.

• Preferred: Master's degree in Computer Science or Information Technology.

Pay: Up to ₹2,200,000.00 per year

Work Location: In person