Databricks Data Engineer

Job highlights

• Bachelor s or Master s degree in Computer Science,Information Technology,Data Engineering,or a related field. Disclaimer : This job posting has been aggregated from external source
• We are looking for a skilled Databricks Data Engineer with hands-on experience in PySpark and SQL to join our data engineering team in Kolkata
• Some experience working with consumer sales data (e.g

Job Title: Databricks Data Engineer

Location: Kolkata, India (On-site)

Experience: 5 8 Years

Notice Period: Immediate Joiners

Job Summary:

We are looking for a skilled Databricks Data Engineer with hands-on experience in PySpark and SQL to join our data engineering team in Kolkata. The ideal candidate will design, develop, and maintain scalable data pipelines and analytics solutions using Databricks, Azure, or AWS environments.

Key responsibilities:

Develop and maintain: design and build scalable data architectures and pipelines to support analytics and business requirements using the most-appropriate tools, technologies and methodologies as well as documenting those solutions in appropriate documentation solutions.

Monitor and troubleshoot: support stakeholders with data issues, monitor existing solutions to ensure seamless operations and minimal downtime.

Optimise and manage: build with continuous improvement in mind and refactoring of existing solutions to ensure robust data pathways and future proof implementations.

Collaborate: Work with cross-functional teams (inside and outside of DX) and with stakeholders to understand data requirements and deliver appropriate solutions.

Share expertise: serve as a SME for best practices, tools and technologies, providing consultancy for stakeholders and teams alike.

Functional Knowledge:

Deep understanding of key data design principles, and appropriate technologies and languages to be able to implement solutions successfully, for example, medallion design, normalisation, SCDs, data lakes, SQL, Python, Git, DevOps etc.

Experience in working with data, transformation of data, and the systems that can be used to provide that transformation and provision of data to end users (e.g. Azure, Databricks, SQL Server etc.).

Desirable to have exposure to SAP but not essential, also some Power BI/Fabric knowledge would be useful.

Relevant degree and strong knowledge in appropriate design principles.

Desirable to have knowledge of LucidChart / diagramming / documentation methodologies.

Business Expertise:

Awareness of emerging technologies for innovation in the data lake space such as Fabric, Databricks, SAP Datasphere, Iceberg etc.

Some experience working with consumer sales data (e.g. master data, sales, forecast) would be useful.

Experience of multinational organisations, and cross functional/cross-cultural operations in these environments.

Education:

Bachelor s or Master s degree in Computer Science, Information Technology, Data Engineering , or a related field.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.