Azure Data Architect

Data Platform Architecture

• Design end-to-end cloud-native data platforms using Azure services.
• Design scalable Lakehouse architectures using Azure Databricks and Delta Lake.
• Establish enterprise data standards and architecture governance.

Azure Databricks Leadership

• Architect Databricks workspaces and multi-environment deployments.
• Define best practices for cluster management, autoscaling, job orchestration, and workload optimization.
• Implement Delta Lake and Medallion Architecture (Bronze, Silver, Gold).
• Drive migration of legacy ETL workloads to Databricks.

Data Governance & Security

• Implement Unity Catalog for centralized governance.
• Define RBAC, data access controls, and row/column-level security.
• Design secure integrations with Key Vault, Managed Identity.
• Ensure compliance with enterprise security standards.

Data Engineering & Optimization

• Review and optimize PySpark code for performance.
• Implement partitioning, Z-Ordering, Liquid Clustering, caching, and query optimization techniques.
• Establish monitoring and observability frameworks.
• Drive FinOps initiatives to optimize Databricks and Azure consumption.

Integration & Orchestration

• Architect data ingestion frameworks using Azure Data Factory.
• Design integrations with SQL Server, SAP, Oracle, APIs, Salesforce, Data Lakes, and third-party systems.
• Implement CI/CD frameworks using Azure DevOps.

Leadership & Stakeholder Management

• Collaborate with business stakeholders, product owners, architects, and engineering teams.
• Conduct architecture reviews and technical governance sessions.
• Mentor Data Engineers and Technical Leads.
• Drive technical roadmap and modernization initiatives.

---

Required Skills

Azure Services

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS)
• Azure Key Vault
• Azure Monitor
• Azure DevOps

Databricks Expertise

• Delta Lake
• Unity Catalog
• Databricks Workflows
• Cluster Policies
• Delta Live Tables (DLT)
• Databricks Asset Bundles
• Structured Streaming

Programming & Data

• PySpark
• Python
• SQL
• Spark Optimization
• Data Modeling
• Data Warehousing Concepts

Architecture

• Lakehouse Architecture
• Medallion Architecture
• Data Governance
• Data Security
• High Availability & Disaster Recovery
• Enterprise Integration Patterns

---

Preferred Skills

• Databricks Certified Data Engineer Professional
• Databricks Certified Data Engineer Associate
• Azure Solutions Architect Expert
• Azure Data Engineer Associate
• Experience in FMCG, Retail, Manufacturing, Healthcare, or Banking domains
• Exposure to Generative AI and Data + AI platforms

---

Must-Have Experience

• 13+ years of Data Engineering experience.
• 5+ years of Azure Databricks implementation experience.
• Experience designing enterprise-scale Lakehouse architectures.
• Hands-on experience with Unity Catalog implementation.
• Strong expertise in PySpark optimization and performance tuning.
• Experience with Azure DevOps CI/CD pipelines.
• Experience leading technical teams and architecture decisions.