Senior Data Engineer / IT Developer – Azure Databricks

We are looking for an experienced Senior Data Engineer / IT Developer to join an exciting assignment with a large organization in Stockholm.

In this role, you will contribute to the development and optimization of a modern, scalable data platform built on Azure and Databricks . The platform supports advanced analytics, reporting, and self-service business intelligence, with a particular focus on HR and People Analytics .

You will work closely with business stakeholders, analysts, and development teams to deliver reliable data pipelines, high-quality datasets, and secure, well-governed data solutions.

Key Responsibilities Data Engineering & Data Modeling

• Design and develop dimensional and semantic data models, including star schemas, Slowly Changing Dimensions (SCD), and role-playing dimensions.
• Build and enhance Bronze, Silver, and Gold layers using Medallion Architecture.
• Develop reusable, scalable, and version-controlled datasets.
• Maintain clear data definitions, documentation, and end-to-end traceability.

Data Pipelines & Platform Development

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks, Azure Data Factory, SQL, and Python/PySpark.
• Work with Delta Lake, Lakeflow, and Unity Catalog.
• Implement incremental data processing and optimize pipeline performance and storage costs.
• Develop reliable data integration solutions across multiple enterprise systems.

Data Quality, Security & Governance

• Implement automated data testing, validation, profiling, and quality monitoring.
• Manage data access and governance using Unity Catalog.
• Apply row-level and column-level security controls.
• Ensure appropriate handling of personal and sensitive information in accordance with GDPR.
• Support data retention policies, documentation, and compliance requirements.

Collaboration & Continuous Improvement

• Translate business requirements into robust technical solutions.
• Collaborate with BI developers to optimize Power BI datasets and semantic models.
• Participate in Agile planning, backlog refinement, and technical discussions.
• Support CI/CD, release management, incident management, and platform improvements.
• Maintain technical documentation and contribute to engineering best practices.

Required Qualifications

• Senior-level professional experience in data engineering or data platform development.
• Strong hands-on experience with Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog.
• Advanced proficiency in SQL, Python, and PySpark.
• Experience developing and orchestrating large-scale pipelines using Azure Data Factory.
• Strong knowledge of dimensional and semantic data modeling, including star schemas, SCD, role-playing dimensions, and calculation groups.
• Experience integrating and modeling data from Workday, Peakon, or equivalent HR, employee experience, or financial systems.
• Experience implementing automated data-quality checks, testing, validation, and monitoring.
• Knowledge of GDPR, data protection, access controls, and information governance.
• Experience working with business stakeholders and translating requirements into scalable technical solutions.
• Strong communication, analytical, and problem-solving skills.