Databricks Architect

Position : Databricks Architect

Purpose of the Position:

To lead the design, development, and implementation of scalable data solutions using Databricks on cloud platforms. The role involves architecting data pipelines, optimizing performance, and ensuring data governance and security across enterprise-level analytics initiative

**s

Key Result Areas and Activities**

• **:

  Architecture Desi** gn: Develop and maintain scalable, secure, and high-performance data architecture using Databric

• ks.Data Pipeline Developme nt: Lead the creation and optimization of ETL/ELT pipelines for structured and unstructured da

• ta.Cloud Integrati on: Ensure seamless integration of Databricks with cloud platforms like Azure, A

• WS.Performance Optimizati on: Monitor and enhance the performance of data workflows and Spark jo

• bs.Stakeholder Collaborati on: Work closely with data engineers, analysts, and business stakeholders to translate requirements into technical solutio

**ns.

Must Have Ski**

• lls

  Strong expertis e in Apache Spark and Datab ricks plat

• form.Hands-on experience with P ytho n or Scala for data engineering t

• asks.Good expertise in Gen AI/LLM automation/modernization proj

• ects.Proficienc y i n SQL for data manipulation and quer

• ying.Hands on experience and awareness about latest features in databricks like AI/BI G e nie, Agentbricks, Databricks

• Apps.Experience with Delta L ake, Lakehouse archite cture, and data versi o

• ning.Knowledg e of CI/CD pipe lines and DevOps prac tices in data enginee

• ring.Familiarity with cloud plat forms (Azure/AWS) and their data serv

• ices.Understandin g of data gover na nce, sec urity, and compl iance framew

• orks.Contribute to presales and

**RFPs.

Good To Have**

• Skill

  Experienc e with MLfl ow and machine learning model dep l

• oyment.Knowle dge of Apache Airflow or other orchestration

• tools.Expos ure to real-time data pro cessing using Kafka or similar

• tools.Familiarit y with P ow er BI, Tableau, or other BI

• tools.Certificat ion in Dat abricks or relevant cloud techno

logies.