DataBricks professional

RGS ID (Please put the requirement ID)

9983401

# of requirements

1

Job Title

Databricks Developer

Relevant Experience

(in Yrs)

5 years+

Technical/Functional Skills

• Minimum 5 years + working exp as Databricks Developer
• Minimum 3 years + working exp on Redshift, Python, PySpark, and AWS
• Associate should hold Databrick Certification

Experience Required

5 years+

Roles Responsibilities

• 5+ years relevant and progressive data engineering experience

• Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored procedures

• Hands-on experience working with data pipelines using a variety of source and target locations (eg, Databricks, Synapse, SQL Server, Data Lake, file-based, SQL and No-SQL database)

• Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes

• Experience developing batch ETL pipelines; real-time pipelines are a plus

• Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data

• Thorough knowledge of Synapse and SQL Server including T-SQL and stored procedures

• Experience working with and supporting cross-functional teams in a dynamic environment

• A successful history of manipulating, processing and extracting value from large disconnected datasets.

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

• Advise, consult, mentor and coach other data and analytic professionals on data standards and practices

• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytic solutions

• Develop and deliver documentation on data engineering capabilities, standards, and processes; participate in coaching, mentoring, design reviews and code reviews

• Partner with business analysts and solutions architects to develop technical architecture for strategic enterprise projects and initiatives.

• Solve complex data problems to deliver insights that helps the organization achieve its goals

• Knowledge and understanding of Boomi is a plus

As it is 24*7 production support project, Resource should will to work in shifts and 7-night shifts in a month

Generic Managerial Skills

Working with multiple stakeholders and architecture review

Education

4 years bachelor s degree

Start date (dd-mmm-yy)

Duration of assignment (in Months)

FTE

Work Location (Remote, if they can work from anywhere or specific location from where associate need to work. If you put specific location then number of profiles received may be less)

Offshore

Salary range

TCS Internal

Key words to search in resume

Primary Skills: Pyspark, AWS Cloud, Airflow, SQL, Databricks

Secondary Skills: Snowflake

Prescreening Questionnaire

Have you worked on Databricks and PySpark programming