AWS Databricks Platform Administrator

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.

Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for talent who can contribute to our growth by delivering top results for our clients.

Job Title: AWS Databricks Platform Administrator

Job Location: Raritan, NJ (Onsite)

Employment Type: 12-month contract

Pay Range : $60–$65/hr.

Job Summary

We are seeking an experienced AWS Databricks Platform Administrator with 9 years of overall IT experience including substantial hands-on expertise in administering, securing, optimizing, and supporting Databricks on AWS. The role will own platform reliability, governance, security, cost management, automation, and operational excellence across enterprise data and analytics workloads. The ideal candidate combines strong Databricks administration skills with deep knowledge of AWS services, infrastructure automation, cloud security, and production support.

Key Responsibilities

• Administer and support Databricks accounts, workspaces, Unity Catalog metastores, clusters, SQL warehouses, jobs, instance pools, repositories, libraries, secrets, and access controls on AWS

• Design and maintain secure, scalable, and highly available Databricks platform architecture aligned with enterprise cloud standards

• Manage identity and access through IAM roles and policies, service principals, single sign-on, SCIM provisioning, and role-based access control

• Implement data governance using Unity Catalog including catalogs, schemas, external locations, storage credentials, privileges, lineage, and auditability

• Configure and troubleshoot AWS integrations such as S3, IAM, VPC, PrivateLink, KMS, CloudWatch, CloudTrail, Route 53, and Secrets Manager

• Establish cluster policies, approved runtime standards, library controls, tagging, auto-termination, serverless usage guidelines, and workload isolation

• Monitor platform health, performance, job reliability, capacity, and usage; proactively identify and resolve bottlenecks and recurring issues

• Drive FinOps practices by analyzing DBU and AWS consumption, enforcing tagging and budgets, optimizing compute configurations, and reducing idle or inefficient resources

• Automate workspace provisioning, configuration, policy enforcement, and operational tasks using Terraform, Databricks Asset Bundles, Databricks CLI/SDK, Python, and CI/CD pipelines

• Lead incident, problem, change, release, vulnerability, and service-request management for the platform while meeting agreed SLAs and operational KPIs

• Plan and execute runtime upgrades, platform migrations, disaster-recovery tests, backup validation, and business-continuity activities

• Partner with data engineering, analytics, security, networking, cloud engineering, and application teams to onboard workloads and resolve complex technical issues

• Maintain architecture diagrams, runbooks, standard operating procedures, support documentation, compliance evidence, and knowledge articles

• Provide technical leadership, mentor administrators and engineers, conduct reviews, and define platform standards and product roadmaps

• Coordinate with Databricks and AWS support teams for critical incidents, product defects, and service improvements

Required Experience and Qualifications

• 9 years of overall experience in cloud infrastructure, data platforms, DevOps, platform engineering, or production administration

• 5 years of hands-on Databricks administration experience, preferably with enterprise deployments on AWS

• Strong experience with Databricks account console/workspace administration, Unity Catalog, cluster policies, SQL warehouses, jobs, Delta Lake, system tables, and audit logs

• Strong knowledge of AWS networking, security, storage, encryption, monitoring, and identity services, particularly VPC, S3, IAM, KMS, PrivateLink, CloudWatch, and CloudTrail

• Hands-on experience with infrastructure as code and automation using Terraform, Python, shell scripting, REST APIs, Databricks CLI/SDK, and CI/CD tools

• Proven experience supporting business-critical platforms in production including incident response, root cause analysis, change management, capacity planning, and SLA governance

• Working knowledge of Linux administration, networking, DNS, firewalls, certificates, proxies, and secure connectivity patterns

• Good understanding of Spark architecture, Delta Lake workload performance, data lakehouse patterns, and troubleshooting distributed data workloads

• Experience implementing security controls including least privilege access, secrets management, encryption, audit logging, vulnerability remediation, and compliance requirements

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent relevant experience

Technical Competencies

• Databricks: account and workspace administration, Unity Catalog, Delta Lake, SQL warehouses, clusters, jobs, notebooks, repos, instance pools, secrets, system tables, audit logs, and cost controls

• AWS: S3, IAM, VPC, EC2, KMS, PrivateLink, CloudWatch, CloudTrail, Route 53, Secrets Manager, Lambda, and AWS Organizations

• Operations: monitoring/observability, performance tuning, capacity management, FinOps, compliance, disaster recovery

Accommodation

Droisys provides reasonable accommodations for qualified individuals with disabilities and for other needs as required by applicable law during the application and hiring process.

Equal Opportunity Employer

Droisys is an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.