Senior Engineer - Data & AI

We are looking for a hands-on Databricks DevOps Lead with 5+ years of experience to own and manage the deployment, administration, governance, and operational aspects of Databricks solutions.

The candidate will be responsible for solution deployment across Data Engineering, Data Science, and AI/ML workloads, with strong hands-on expertise in CI/CD, Git, Jenkins, Databricks Administration, access management, monitoring, and release management.

This is a full-time role for an initial 3-month duration. The candidate will be based in Mumbai or Pune and should be able to visit the Mumbai office on a need basis.

---

Key Responsibilities

Solution Deployment & DevOps

Manage end-to-end deployment of solutions across Data Engineering, Data Science, and AI/ML workloads.

Implement and maintain CI/CD pipelines for Databricks solutions.

Perform deployment, maintenance, monitoring, and operational support of deployed solutions.

Ensure reliable and repeatable deployment processes across environments.

Troubleshoot deployment issues and drive timely resolution.

Databricks Administration & Governance

Handle Databricks Administration activities, including workspace and platform operations.

Manage user access, permissions, and access management.

Support governance requirements and ensure adherence to defined platform standards.

Provision and deploy value-case operations as required.

Monitor deployed workloads and ensure platform reliability.

CI/CD, Git & Jenkins

Set up and maintain Git-based development and deployment workflows.

Configure and manage Jenkins for CI/CD automation.

Develop and maintain deployment pipelines for Databricks workloads.

Ensure source control, build, deployment, and release processes are properly managed.

Release Management & Support

Maintain release schedules and coordinate release activities.

Perform release deployments across required environments.

Take ownership of deployment-related issues and provide effective solutions.

Monitor deployments and resolve production or environment-related issues.

Ensure smooth and controlled releases with minimal disruption.

Problem Solving & Ownership

Investigate technical issues related to deployments, pipelines, access, and platform operations.

Provide timely issue resolution and root-cause analysis.

Take end-to-end ownership of deployment and DevOps activities.

Collaborate with Data Engineering, Data Science, and AI/ML teams to support successful solution delivery.

---

Roles and Responsibilities

5+ years of experience in DevOps, cloud data platforms, or related technology roles.

Strong hands-on experience in Databricks solution deployment.

Experience deploying solutions across Data Engineering, Data Science, and AI/ML environments.

Strong hands-on experience with CI/CD implementation and deployment automation.

Hands-on experience setting up and managing Git and Jenkins.

Experience with Databricks Administration, access management, and governance.

Strong troubleshooting, issue-resolution, and problem-solving skills.

Experience in release management, release scheduling, and deployment execution.

Strong sense of ownership and ability to independently manage deployment activities.

Good communication and collaboration skills.---

Preferred Qualifications

Experience working with enterprise Databricks environments.

Experience supporting multiple deployment environments and release cycles.

Familiarity with DevOps best practices for data and AI/ML workloads.

Experience with monitoring and operational maintenance of deployed solutions.

Experience working with cross-functional Data Engineering, Data Science, and AI/ML teams.