Lead Data Engineer

Job highlights

• Your expertise will be essential in integrating data from diverse structured and unstructured sources across global systems,identifying new data opportunities to enhance analytical capabilities and fuel innovation
• Hands-on experience with leading data engineering tools such as Azure DataBricks,Azure DevOps,and Visual Studio Code

Job Details

Functional area: IT

Onsite or Remote: Hybrid

Country/Region: IN

City: Bengaluru

Location: Bengaluru

Company name: Epiroc

Job Summary

Join Epiroc Mining India Private Ltd in Bengaluru as a Lead Data Engineer and become an integral part of our Corporate Units within the Research and Development department. This role presents a unique opportunity to contribute to Epirocs rapidly evolving AI and digital transformation journey, working within a dynamic and technology-driven environment.

About the Role

As a Lead Data Engineer, you will spearhead the design, development, and maintenance of robust data pipelines and ETL processes that ensure reliable, high-quality data for business and product needs. You will take ownership of performance monitoring and optimization of data workflows, proactively addressing challenges and streamlining processes to support scalable data solutions.

Your expertise will be essential in integrating data from diverse structured and unstructured sources across global systems, identifying new data opportunities to enhance analytical capabilities and fuel innovation. You will play a key role in optimizing indexing strategies for large-scale, multi-domain datasets, ensuring data quality, consistency, and compliance with enterprise standards.

Collaboration is at the heart of this position. You will work closely with AI/ML engineers, data scientists, and product teams to deliver comprehensive end-to-end data solutions. Through active communication and alignment with cross-functional teams, you will help shape data engineering efforts to meet project roadmaps and timelines effectively. Additionally, you will implement monitoring and alerting systems to maintain data pipeline health and ensure service-level agreements are met consistently.

Responsibilities

• Design, implement, and maintain scalable and reliable data pipelines and ETL processes to support diverse business requirements.

• Continuously monitor data pipeline performance and reliability, optimizing workflows and proactively resolving issues.

• Integrate and connect various data sources, including structured and unstructured data from global platforms.

• Identify, evaluate, and integrate new data sources to broaden the scope and improve the quality of available data sets.

• Optimize indexing strategies for handling large-scale, multi-domain datasets efficiently.

• Ensure strict adherence to data quality, consistency, and enterprise compliance standards throughout data processing.

• Develop and implement monitoring and alerting mechanisms to track data pipeline health and SLA compliance.

• Partner with AI/ML engineers, data scientists, and product teams to enable seamless delivery of data-driven solutions.

• Collaborate with cross-functional teams to ensure data engineering initiatives align with strategic project objectives and deadlines.

  Qualifications Skills

• Bachelors or Master s degree in Computer Science Engineering or related field, accompanied by 10+ years of professional experience in data engineering.

• Proficiency with programming languages including Python, PySpark, and SQL for developing efficient and scalable data solutions.

• Hands-on experience with leading data engineering tools such as Azure DataBricks, Azure DevOps, and Visual Studio Code.

• Strong knowledge of REST APIs, facilitating effective data integration and automation.

• Familiarity with Generative AI concepts and experience integrating Large Language Models (LLM) is highly desirable.

• Solid understanding of cloud-based data platforms and designing scalable data architectures.

  Success Behaviors

The ideal candidate is a proactive team player who excels in transparent communication, providing consistent updates to both the team and stakeholders. A customer-focused and adaptable mindset is crucial to navigate a varied and fast-paced work environment. We value a collaborative, approachable, and transparent individual who remains calm and effective in handling critical and urgent situations. Demonstrating these behaviors will empower you to thrive within Epiroc s inclusive and innovative culture.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.