Senior Data Engineer

Senior Data Engineer

Location: Pune (Hybrid)
Experience: 6+ Years

Job Description

We are hiring a Senior Data Engineer to design, develop, and optimize scalable data pipelines and modern data platform solutions. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms, and data governance.

Key Skills:

• Python, PySpark, SQL
• Apache Spark, Databricks
• Hive, Hadoop, Cloudera
• Azure, Microsoft Fabric, OneLake
• SSIS, SQL Server, Stored Procedures
• ETL/ELT, Data Warehousing
• Data Quality, Metadata, Governance & Lineage
• Real-time/Streaming Data Pipelines
• Power BI (Preferred)

Responsibilities:

• Build and maintain scalable batch and near real-time data pipelines.
• Develop data ingestion, transformation, and orchestration workflows.
• Support data lake and lakehouse modernization initiatives.
• Implement data quality, governance, and lineage solutions.
• Collaborate with Product, Architecture, Engineering, and Analytics teams.
• Troubleshoot production issues and optimize platform performance.
• Support analytics, reporting, and AI-driven data initiatives.

Requirements:

• 6+ years of experience in Data Engineering or Big Data environments.
• Strong hands-on experience with Spark, Python, SQL, and Databricks.
• Experience building enterprise-scale data pipelines and distributed processing systems.
• Expertise in ETL/ELT frameworks and cloud-based data platforms.
• Strong problem-solving, communication, and stakeholder management skills.

Preferred Qualifications:

• Experience with Microsoft Fabric, OneLake, and cloud-native platforms.
• Exposure to observability/log streaming tools like Cribl.
• Experience supporting Analytics, Reporting, AI, or ML workloads.
• Ability to mentor team members and drive technical initiatives.