Senior Devops Engineer

Company: Thoughtworks

Website: Visit Website

Business Type: Enterprise

Company Type: Product & Service

Business Model: B2B

Funding Stage: IPO/Public

Industry: Information Technology

Salary Range: ₹ 15-28 Lacs PA

Job Description Thoughtworks is a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. With over 30 years of experience, Thoughtworks helps enterprises modernize legacy systems, build scalable digital platforms, and deliver impactful software solutions. Known for its strong engineering culture and commitment to open-source, Thoughtworks partners with clients to solve complex business problems using cutting-edge technologies and agile practices.

Must Have Experience

• 5+ years of experience in DevOps or Cloud Engineering roles.
• Cloud - Azure: Networking, Key Vault, Az CLI, ADF, Databricks/Snowflake, ADLS, Azure Storage.
• DataBricks: Provisioning, Workspace Management, Secret Management, Networking, Pipelines Management, Databricks Bundles.
• IAC: Terraform, CI/CD Pipelines on GitHub, Shell/Python Scripting, REST API
• Databricks experience is mandatory.
• The candidate will be an individual contributor.

Nice To Have Unity Catalog, Delta Lake Table Format, PySpark, Py Wheel, PostgreSQL Management

Soft Skills

• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.

What would you do here? Senior Cloud Infrastructure Engineer for Data Platform The ideal candidate will play a critical role in designing, implementing, and maintaining cloud infrastructure and CI/CD pipelines to support scalable, secure, and efficient data and analytics solutions. This role requires a strong understanding of cloud-native technologies, DevOps best practices, and hands-on experience with Azure and Databricks.

Key Responsibilities Cloud Infrastructure Design & Management:

• Architect, deploy, and manage scalable and secure cloud infrastructure on Microsoft Azure.
• Implement best practices for Azure Resource Management, including resource groups, virtual networks, and storage accounts.
• Optimize cloud costs and ensure high availability and disaster recovery for critical systems

Databricks Platform Management

• Set up, configure, and maintain Databricks workspaces for data engineering, machine learning, and analytics workloads.
• Automate cluster management, job scheduling, and monitoring within Databricks.
• Collaborate with data teams to optimize Databricks performance and ensure seamless integration with Azure services.

CI/CD Pipeline Development

• Design and implement CI/CD pipelines for deploying infrastructure, applications, and data workflows using tools like Azure DevOps, GitHub Actions, or similar.
• Automate testing, deployment, and monitoring processes to ensure rapid and reliable delivery of updates.

Monitoring & Incident Management

• Implement monitoring and alerting solutions using tools like Dynatrace, Azure Monitor, Log Analytics, and Databricks metrics.
• Troubleshoot and resolve infrastructure and application issues, ensuring minimal downtime.

Security & Compliance:

• Enforce security best practices, including identity and access management (IAM), encryption, and network security.
• Ensure compliance with organizational and regulatory standards for data protection and cloud operations.

Collaboration & Documentation

• Work closely with cross-functional teams, including data engineers, software developers, and business stakeholders, to align infrastructure with business needs.
• Maintain comprehensive documentation for infrastructure, processes, and configurations.