Databricks Platform Engineer

About the Role

We are seeking an experienced Databricks Platform Engineer. In this role, you will design and establish the enterprise Databricks platform foundation, enabling secure, governed, scalable, and cost-efficient execution for both migrated and future workloads.

Key Responsibilities

• Platform Architecture: Design workspace, compute, networking, security, and environment architecture across Dev, SIT, UAT, and Prod environments.
• Azure Integration: Define integrations with ADLS Gen2, Microsoft Entra ID, Key Vault, Azure Networking, Azure DevOps, ADF, Purview, and Azure Monitor.
• Automation & CI/CD: Establish CI/CD pipelines, Infrastructure-as-Code (Terraform), Databricks Asset Bundles, and platform automation standards.
• Governance & FinOps: Define compute governance, performance, scalability, reliability, and cost-optimization strategies.
• Migration Support: Establish platform standards and reusable patterns to support a Synapse-to-Databricks migration.

Skills & Experience

• Databricks Expertise: Strong expertise in Azure Databricks platform architecture and enterprise deployment.

• Data Governance: In-depth experience with Unity Catalog, including governance, access control, lineage, external locations, and data security.

• Platform Automation: Proven experience with Databricks-native capabilities and APIs.

• AI & Automation Tools: Exposure to AI-assisted platform engineering, automation, and agentic tools (e.g., Claude, Codex, or Gemini) is highly preferred.

• Certifications (Preferred):

  • Azure Solutions Architect Expert, and/or
  • Azure Databricks Data Engineer Associate

To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Yash Kumar Jain on [03 8680 4235](tel:03 8680 4235) or email: [email protected] and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.