Data Engineer- Databricks + AWS

Position: Data Engineer- Databricks + AWS

Purpose of the Position:

Develop, support and steer end-to-end business intelligence using Databricks

Location: Nagpur/ Pune/ Bangalore/ Chennai

Key Responsibilities:

• Work with account/project architects to understand and translate requirements into technical implementations.

• Develop, implement, and maintain pyspark code through Databricks UI that enables data and analytics use cases for the client.

• Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.

Roles and Responsibilities

Work and Technical Experience:

Mandatory Skills:

• Overall 5+ and 3+ Hands on Experience with Databricks, PySpark and Python

• Thorough understanding of Databricks Unity Catalog, Notebook, Autoloader, Data apps, Genie and other key services/features

• Proficiency in SQL and data manipulation skills

• Understanding of data warehousing concepts and technologies.

Desirable Skills:

• Understanding of AWS platform and its key services like S3, Lambda etc.

• Familiarity with ETL processes and tools for data extraction, transformation, and loading.

• Familiarity with AI/BI dashboards in Databricks, Agentic workflows in Databricks

Qualifications:

• Bachelor’s degree in computer science, engineering, or related field

• Demonstrated continued learning through one or more technical certifications or related methods

• 5+ years of relevant experience in Data Engineering

• Relevant experience in media domain

Qualities:

• Self-motivated and focused on delivering outcomes for a fast-growing team and firm

• Able to communicate persuasively through speaking, writing, and client presentations

• Able to consult, write, and present persuasively

• Able to work in a self-organized and cross-functional team

• Able to iterate based on new information, peer reviews, and feedback

• Able to work with teams and clients in different time zones

• Research focused mindset