Data Engineer

Designation: Senior Data Engineer

Experience : 6 to 10 years

Qualification : BE/B tech, ME/M tech, Bsc, Msc.

Location : Hyderabad, Bangalore and Mumbai

Job Description

As a Senior Data Engineer, you will own the end-to-end data platform, from raw data ingestion through transformation to trusted, business-ready datasets. You will be responsible for designing, building, and maintaining scalable, reliable, and high-quality data pipelines that power analytics and decision-making across the organization.

This role requires someone who can make sound architectural decisions, balance trade-offs, and deliver production-grade solutions in a fast-paced environment. You'll partner closely with analysts, engineers, and business stakeholders, ensuring data solutions are reliable, maintainable, and aligned with business needs. A strong bias for action, systems thinking, and expertise in modern data engineering practices are essential.Key Responsibilities

• Design, build, and maintain end-to-end data pipelines from ingestion to curated, trusted data models.
• Develop scalable and maintainable data transformation layers using modern transformation frameworks.
• Design and optimize data warehouse schemas and data models to support reporting and analytics.
• Write highly efficient, production-grade SQL and optimize complex queries for performance.
• Build, maintain, and monitor orchestration workflows, ensuring proper dependency management and data lineage.
• Implement data quality, validation, monitoring, and reliability practices to ensure trusted datasets.
• Make architecture and design decisions while balancing scalability, maintainability, and delivery speed.
• Collaborate closely with analysts, engineers, and business stakeholders to understand requirements and translate them into robust data solutions.
• Proactively identify improvements in data architecture, pipeline performance, and engineering practices.
• Leverage Large Language Models (LLMs) and AI-assisted development tools to improve engineering productivity and accelerate delivery.
• Build solutions that are production-ready, scalable, and resilient while maintaining high development velocity.

Must-Have Skills

Technical Skills

• Expert-level proficiency in SQL, including complex query optimization, performance tuning, and advanced data modeling.

• Strong expertise in data warehousing concepts, dimensional modeling, and analytical database design.

• Hands-on experience with modern data transformation frameworks such as:

• dbt

• SQLMesh

• Strong understanding of workflow orchestration, DAG design, dependency management, and data lineage.

• Experience designing and maintaining reliable, production-grade data pipelines.

• Strong knowledge of data quality frameworks, testing, validation, and monitoring.

• Excellent systems thinking with the ability to design scalable and maintainable data architectures.

• Proven ability to deliver high-quality solutions in fast-paced, agile environments.

AI & LLM Skills (Mandatory)

Demonstrated hands-on experience using Large Language Models (LLMs) as a core part of the software development lifecycle, including:

• Prompt engineering
• Context engineering
• Retrieval-Augmented Generation (RAG)
• Vector embeddings and vector search
• Token optimization and context management
• LLM evaluations and quality assessment
• Guardrails and hallucination mitigation
• Function calling, tool use, and AI workflow orchestration

Candidates should have practical experience integrating AI into engineering workflows rather than limited exposure or experimentation.

Professional Skills

• Strong communication and stakeholder management skills.
• Ability to challenge requirements constructively and provide technical guidance.
• Strong ownership mindset with the ability to make informed technical decisions independently.
• Bias toward execution, continuous improvement, and delivering business value.

Nice-to-Have Skills

• Hands-on experience building and operating data platforms on Databricks.
• Experience with AI-assisted or "vibe coding" approaches to software development.
• Exposure to fintech, banking, payments, or financial services data platforms.
• Experience designing scalable data architectures in cloud-native environments.
• Familiarity with modern DevOps, CI/CD, Infrastructure as Code (IaC), and observability practices.
• Experience working in high-growth startups or small engineering teams with broad ownership.