Consultant Data Engineer Databricks

Contract Role – Consultant Data Engineer Databricks – Dublin/Letterkenny – Till Mar 2027

Consultant Data Engineer Databricks who will contribute to the design, build, and evolution of data solutions build in Databricks.

Role Overview:

• Job Title: Consultant Data Engineer Databricks
• Location: Dublin/Letterkenny/Hybrid
• Contract Type: Contract
• Duration: Initially till Mar 2027
• Sector: Healthcare .

(Candidates must have the legal right to work in Ireland and be currently based in Ireland)

Consultant Data Engineer who will contribute to the design, build, and evolution of data solutions which serve U.S. healthcare. You will work at the intersection of engineering, analytics, and business strategy-building scalable, trusted data solutions and enabling advanced analytical, data science and artificial intelligence capabilities.

What you will do:

• Serve as the hands-on data engineering subject matter expert for technical initiatives, contributing to technical direction while designing and delivering critical data capabilities
• Design and build scalable, reliable data products and platform components using modern cloud, Lakehouse, and software engineering practices
• Partner closely with product, business, architecture, security, governance, and engineering stakeholders to translate complex needs into pragmatic technical solutions
• Contribute to a large scale migration from Databricks Cluster to an Enterprise Managed Databrick cluster.
• Provide technical mentorship to junior team members, design guidance, and constructive review to engineers, raising
• Data capability across the team without direct people-management responsibility
• You will be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role, as well as providing development for other roles you may be interested in.

What you will bring:

• Bachelor's degree or higher in a relevant Computer Science field, or equivalent professional experience
• 8+ years demonstrated experience contributing to complex data products or platforms i.e. hands-on in design and delivery of Data solutions
• 8+ years’ experience designing and building scalable data solutions accounting for pipeline infrastructure and analytical operations.
• Experience with high-volume batch data pipelines within a public cloud environment ideally Azure.
• 5+ years’ experience working with Databricks, Apache Spark.
• 2+ years’ experience working with DBT.
• Demonstrated advanced proficiency in SQL and a general-purpose programming language such as Python or Scala
• Demonstrated solid understanding of data modelling, distributed data processing, metadata management, data quality, lineage, and observability
• Proven experience implementing data pipeline orchestration solutions using tooling such as Apache Airflow or Native Databricks orchestration.
• Experience making and communicating design decisions across security, reliability, performance, scalability, cost, and maintainability considerations
• Demonstrated solid understanding of software engineering practices, including automated testing, version control, CI/CD, infrastructure as code, and operational support
• Demonstrated understanding of cloud security, identity and access management, tenant isolation, and privacy principles for sensitive data
• Proven experience partnering with product, business, architecture, AI, security, and governance stakeholders to translate ambiguous requirements into deliverable technical strategies
• Proven ability to communicate complex concepts clearly to technical and non-technical audiences

Other useful skills and experience include:

• Proven hands-on experience with Azure data services or Azure Cloud Ecosystem technologies.
• Proven experience with GitHub Actions Workflows
• Proven experience working with Snowflake, Terraform, or equivalent technologies
• Demonstrated knowledge of data cataloguing, governance, and security controls for sensitive or regulated data
• Experience within the healthcare industry

Please feel free to contact myself – Daisy Nguyen at Gibbs Consulting/Atrium UK for a confidential chat to know more details about the role.

Please also note: Due to the volume of applications received for positions, it will not be possible to respond to all applications and only applicants who are considered suitable for interview will be contacted.