Data bricks Architect

Role Overview

Serves as the core technical authority for designing, modernizing, and optimizing the Databricks Lakehouse architecture, code refactoring, and data execution pipelines.

Key Roles & Responsibilities

• Refactoring & Modernization: Refactor legacy Synapse T-SQL stored procedures, scripts, and views into native PySpark, Databricks SQL, or Delta Live Tables (DLT).
• Storage Optimization: Transition legacy Synapse distribution schemas (HASH, ROUND_ROBIN, REPLICATE) to Delta Lake Liquid Clustering (CLUSTER BY) for optimal query performance and reduced maintenance.
• Pipeline Design: Design efficient batch and streaming ingestion patterns leveraging Auto Loader and Delta Lake Lakehouse mechanisms.
• Performance Tuning: Execute comprehensive tuning using OPTIMIZE, Z-ORDER, compute cluster sizing, and Serverless warehouse setup.

EDUCATION & QUALIFICATIONS

Bachelor's degree in Computer Science/IT/MSC/MBA. Any Related Field.

Key Skills Required

• Architecture & Governance: End-to-end Target State Architecture blueprints utilizing Unity Catalog and Delta Live Tables; articulating design decisions, build vs. buy evaluations, and balancing performance against licensing costs.
• Databricks Ecosystem: Databricks Runtime, Delta Lake, Delta Live Tables (DLT).
• Performance & Storage: Liquid Clustering, Partitioning Strategies, Auto Loader, DB SQL Serverless.
• Programming Languages: Python, PySpark, Advanced SQL (Scala is optional).

CI/CD & Tools: Databricks Asset Bundles (DABs), dbx, Git integration, MLflow

Pay: ₹1,500,000.00 - ₹3,000,000.00 per year

Application Question(s):

• Immediate to max 30 days preferred

Experience:

• data bricks: 10 years (Preferred)

Work Location: In person