AWS DevOps for Data Platforms

Day to Day Job Duties

Design and maintain Terraform-based Infrastructure as Code (IaC) solutions to deploy secure, scalable Databricks and Snowflake environments on AWS.

Develop reusable Terraform modules, templates, and deployment pipelines that automate cloud infrastructure provisioning, security controls, networking, identity management, and platform configuration.

Partner with Cloud Architects, Security Engineers, and Data Engineering teams to establish deployment standards, operational processes, and platform architectures.

Implement and manage CI/CD pipelines for infrastructure deployments, environment promotion, release automation, and configuration management.

Deploy and manage AWS infrastructure components including VPCs, IAM roles, encryption services, private networking, secrets management, monitoring, and logging capabilities.

Automate Databricks workspace, Unity Catalog, cluster policy, and platform integration deployments using Terraform and APIs.

Automate Snowflake account, warehouse, database, role, and security configurations through Infrastructure as Code frameworks.

Collaborate with security and compliance teams to ensure deployments meet enterprise governance, risk, and regulatory requirements.

Troubleshoot infrastructure, networking, authentication, and platform integration issues across AWS, Databricks, and Snowflake environments.

Contribute to reusable deployment frameworks, cloud landing zones, infrastructure standards, and DevOps best practices.

Basic Qualifications Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.

Minimum 5+ years of hands-on experience building and deploying Infrastructure as Code solutions using Terraform.

Minimum 5+ years of experience working with AWS services including networking, security, IAM, monitoring, and cloud operations.

Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.

Minimum 3+ years of experience deploying secure enterprise cloud environments with encryption, access controls, secrets management, and network segmentation.

Minimum 2+ years of hands-on experience deploying and administering Databricks on AWS, including workspace provisioning, networking, and Unity Catalog.

Minimum 2+ years of hands-on experience deploying and administering Snowflake environments, including security, access controls, and infrastructure automation.

Minimum 2+ years of experience developing automation scripts using Python, Bash, or PowerShell.

Experience with AWS security services including IAM, KMS, Secrets Manager, CloudTrail, and GuardDuty.

Experience implementing DevSecOps, infrastructure governance, compliance controls, and automated policy enforcement.

Experience working in Agile delivery environments with sprint-based development and stakeholder collaboration.

Strong client-facing communication skills with the ability to lead architecture reviews, deployment planning sessions, and technical workshops.

Preferred Qualifications Experience deploying Databricks and Snowflake together within an AWS enterprise data platform.

Experience implementing PrivateLink, zero-trust networking, and secure cloud connectivity patterns.

Experience supporting financial services, banking, healthcare, or other regulated industries.

AWS, Terraform, Snowflake, or Databricks certifications preferred.