Data Engineer (m/f/d) Microsoft Fabric

Job ID: 3560644

Data Engineer (m/f/d) Microsoft Fabric

Warsaw

Professional

Application deadline: 30.12.2026

Regular (Part Time Possible)

T-Hub Polska

Your Task

• Build and maintain scalable data pipelines in Microsoft Fabric, including Lakehouse, Pipelines, Notebooks, Delta Lake, and Medallion Architecture, to process global IoT SIM data efficiently and reliably.
• Develop robust ingestion and transformation workflows for Oracle, SAP, CSV, CDC, APIs, and CMP sources, structuring data through Medallion Architecture (Bronze/Silver/Gold) and reusable data models.
• Implement data quality checks, validation rules, monitoring, and automated error handling to ensure trusted datasets for reporting, analytics, and operational use cases.
• Collaborate with architects, product owners, analysts, development, QA, and DevOps teams to industrialize data products, establish CI/CD practices, and support operational run models.

Your Profile

Must have:

• Strong hands-on experience with Microsoft Fabric or comparable Azure data engineering platforms, including Lakehouse patterns, Delta Lake, data pipelines, and notebook-based transformations.
• Advanced Python, SQL, and PySpark skills for large-scale data ingestion, transformation, migration, and optimization of IoT SIM, lifecycle, usage, and network telemetry data.
• Experience with Medallion Architecture (Bronze/Silver/Gold), data modeling for analytical workloads, partitioning, performance tuning, and preparation of reliable datasets for downstream consumption.
• Practical experience with data quality frameworks, orchestration, monitoring, Git-based development, CI/CD, and production-grade data operations.

Nice-to-have

• Hands-on experience with real-time or near-real-time streaming concepts, such as Apache Kafka, Fabric Eventstream, Event Hubs, or similar technologies.
• Background in Data Governance, Microsoft Purview, CMP integrations, telecommunications data models, secure data engineering patterns, or legacy SAP/Oracle modernization.
• Experience with Power BI semantic models, Direct Lake, self-service analytics enablement, or controlled access concepts such as Entra ID, OAuth2, Azure Key Vault, Private Endpoints, and Data Gateways.
• Certifications: DP-600, DP-203, or AZ-305.

About Us

In this role, you will design, implement, and maintain ingestion, transformation, and data quality workflows for SIM lifecycle, usage, network, and partner connectivity data from multiple source systems and regions. You will modernize and transition data pipelines from legacy systems such as Oracle and SAP into Microsoft Fabric, integrate external Connectivity Management Platforms (CMPs), and provide reliable, analytics-ready datasets for internal teams and partner-facing use cases. The role is focused on practical data pipeline engineering, automation, monitoring, and operational reliability.