Staff Data Engineer, Observability Data Lake

For our client, we are seeking a Staff Data Engineer, Observability Data Lake to join the team of a leader in the Healthcare space.

This role will focus on designing and scaling data engineering solutions that support observability and security use cases across a large healthcare environment. The position will partner closely with engineering teams to build reliable data pipelines, improve performance, and strengthen governance standards. The ideal candidate will bring deep expertise in modern lakehouse architectures and high-volume data processing to help advance data quality, operational stability, and platform excellence.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $118,450 – $236,900 annually

Responsibilities

• Design and deploy scalable Databricks-based data pipelines for observability and security data
• Optimize PySpark workloads and ensure high performance and reliability
• Onboard new data sources and establish governance standards in collaboration with engineering teams
• Contribute to code reviews and engineering standards to address technical debt
• Promote best practices for data governance and platform operations

Qualifications

• 7+ years of experience building enterprise data engineering solutions with Python, Spark, and SQL
• 6+ years designing and operating large-scale data pipelines and lakehouse architectures
• 5+ years working with Databricks, including Delta Lake and performance optimization
• 4+ years developing high-volume batch and streaming data solutions with data quality controls
• 2+ years collaborating with engineering teams and communicating technical solutions effectively

Benefits

• Comprehensive medical, dental, and vision coverage
• Paid time off to support work-life balance
• Retirement savings options to prepare for the future
• Wellness programs aimed at physical and emotional well-being

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.