Databrick Architect

Databricks Field ARCHITECT -- Data Modernization (Databricks)

Project Overview:

We are undertaking a Data Modernization initiative to migrate data from multiple legacy on-prem and cloud systems into Databricks, enabling a unified, scalable, and analytics-ready data platform. The program focuses on modernizing data ingestion, transformation, governance, and reporting while ensuring security, performance, and cost optimization.

Role Summary

We are looking for an experienced Databricks Field ARCHITECT who has led or significantly contributed to data modernization projects using Databricks. The Field ARCHITECT will be responsible for end-to-end architecture design, migration strategy, and technical leadership for moving legacy data platforms into a modern Databricks-based ecosystem.

Key Responsibilities

Architecture & Design

• Design and own the end-to-end data architecture for migration from legacy systems (on-prem databases, data warehouses, flat files, ETL tools) to Databricks

• Define target-state architecture leveraging Databricks components such as:

◦ Unity Catalog (unified governance & data lakehouse storage)

◦ Databricks Workflows & Delta Live Tables (orchestration)

◦ Delta Lake Lakehouse & Databricks SQL Warehouses

◦ Databricks Data Engineering & Spark-based pipelines

◦ Power BI / Databricks SQL semantic models & dashboards

• Establish architectural standards, design patterns, and best practices

Data Modernization & Migration

• Assess existing legacy data platforms and define migration and modernization strategy

• Lead data ingestion, transformation, and orchestration using Databricks Workflows / Delta Live Tables

• Design scalable ELT/ETL pipelines and incremental data loads

• Plan and execute phased migrations with minimal business disruption

Governance, Security & Performance

• Implement data governance, security, and compliance using Unity Catalog (governance & lineage) and Databricks security models

• Define data access, role-based security, and data sharing strategies

• Optimize performance, storage, and compute costs within Databricks

• Ensure data quality, lineage, and observability

Collaboration & Leadership

• Work closely with business stakeholders, product owners, and analytics teams to translate requirements into architecture

• Work closely with Databricks Alliance and Partner channels

• Provide technical leadership to data engineers and BI developers

• Review designs, code, and implementation for alignment with architecture

• Support testing, cutover, and post-migration stabilization

Required Skills & Experience

Must Have

• 8+ years of overall data & cloud experience with strong Databricks architecture background

• Hands-on experience with Databricks in at least one data modernization or migration project

• Strong expertise in:

◦ Databricks Workflows / Delta Live Tables

◦ Delta Lake Lakehouse & Databricks SQL Warehouses

◦ Cloud data lake storage (ADLS Gen2 / S3 / GCS) with Unity Catalog

◦ Power BI (enterprise semantic models)

• Experience migrating from legacy systems (on-prem databases, traditional DWs, legacy ETL tools) • Strong SQL and data modeling skills

• Experience designing enterprise-scale data platforms