Senior Big Data Administrator

Job highlights

• Education / Certification
• AWS certification is a plus
• in Computer Science or related field or equivalent work experience required
• Experience with microservices architecture and distributed systems.
• Solid experience with Databricks (cluster management,job orchestration,integrations). Strong scripting skills (Python / Bash / PowerShell).

Overview About Business Unit: At the core of all that Epsilon does is a team that sets the foundation of our IT infrastructure. The team drives innovation and efficiency through pioneering technology across Epsilons platforms and business verticals. From being the first point of contact for infrastructure needs to final deployment, the team provides end-to-end solutions for our client-facing platforms. ETS supports all aspects of revenue-generating platforms for Epsilon and sets the architectural direction for our enterprise deployments. By adopting the newest technologies, such as Cloud, Automation, and Artificial Intelligence, the team is at the front of redefining our digital business and capturing new opportunities. Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice.

Responsibilities

• Design, implement, and manage CI/CD pipelines for microservices and data workloads
• Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code.
• Support deployment and orchestration of microservices-based applications (Docker, Kubernetes)
• Manage and optimize Databricks environments for data engineering and analytics workloads
• Automate operational workflows, monitoring, and alerting for high availability systems
• Collaborate with development, data engineering, and platform teams to ensure seamless delivery
• Ensure security, compliance, and cost optimization across cloud resources
• Troubleshoot deployment, performance, and infrastructure issues

Qualifications

• 5+ years of experience in DevOps Microservices
• Proficiency in backup and recovery methodologies and techniques
• Ability to diagnose problems and resolve issues across various tiers (application, database , network and appliance)
• Adherence to SDLC, Change Management, troubleshooting and development methodologies
• Strong Unix/Linux and shell scripting
• Ability to perform work with minimal supervisory direction
• Excellent written and verbal communication skills
• Strong hands-on expertise with: CI/CD tools: Azure DevOps, Jenkins, GitHub Actions
• Containerization: Docker
• Orchestration: Kubernetes (EKS/AKS/GKE)
• Experience with microservices architecture and distributed systems
• Solid experience with Databricks (cluster management, job orchestration, integrations)
• Strong scripting skills (Python / Bash / PowerShell)
• Experience with Infrastructure as Code (Terraform / ARM / CloudFormation)
• Knowledge of monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor)
• Experience with data engineering pipelines (Spark, Delta Lake)
• Exposure to streaming architectures (Kafka, Event Hubs)
• Understanding of data lake / lakehouse architectures
• Experience with multi-region / high-availability setups
• Cloud certifications (AWS / Azure DevOps / Databricks)

Education/Certification

• B.S. in Computer Science or related field or equivalent work experience required. AWS certification is a plus.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.