Databricks Engineer

Job highlights

• Server. * Experience in cloud migration projects is a plus (Azure preferred). * Excellent problem-solving skills and a proactive approach to infrastructure challenges.
• Required Skills and Experience
• Preferred Qualifications

Key Responsibilities:
* Infrastructure Assessment & Planning
o Assess current data platform infrastructure and recommend DevOps strategies for
optimization.
o Define and document DevOps architecture and operational workflows.
* CI/CD Automation
o Design, implement, and manage CI/CD pipelines for Databricks workflows.
o Integrate automation with version control and deployment processes.
* Governance & Access Management
o Manage access controls for both Databricks and Power BI platforms.
o Establish and maintain governance policies, including role-based access.
* Catalog & Data Management
o Create and manage Databricks catalogs for data governance and discoverability.
o Monitor and manage ELT/ETL job refresh cycles to ensure data reliability.
* Capacity Planning
o Monitor and manage Power BI capacity to optimize performance and resource usage.
* Application and Server Management
o Support a centralized on-prem web server hosting multiple .NET applications.
o Work with the team on potential migration of .NET applications and SQL Server
environments to the cloud.
Required Skills and Experience
* 8+ years of experience in DevOps, preferably in data-centric environments.
* Proven experience with Azure and related services.
* Proven experience with Databricks CI/CD pipeline automation.
* Strong knowledge of Power BI administration and capacity management.
* Experience managing access and governance in cloud-based data platforms.
* Familiarity with ETL/ELT processes and monitoring data pipelines.
* Hands-on experience with .NET-based applications, web server administration, and SQL
Server.
* Experience in cloud migration projects is a plus (Azure preferred).
* Excellent problem-solving skills and a proactive approach to infrastructure challenges.
Preferred Qualifications
* Certifications in Azure, Databricks, or DevOps tools.
* Experience in scripting (e.g., Python, PowerShell) and infrastructure as code (e.g.,
Terraform,
ARM templates).
* Familiarity with data security standards and compliance requirements

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.