Microsoft Fabric and Databricks Developer

Microsoft Fabric and Databricks Developer

Location: Remote

Employment Type: Project Based

The Role

The Microsoft Fabric and Databricks Developer will be responsible for designing, developing, and maintaining scalable data solutions using Microsoft Fabric and Databricks. You will work within an Agile team to build and optimize data pipelines, lakehouse architectures, data transformations, and analytics solutions, ensuring reliable, secure, and cost-effective delivery that meets client requirements.

Responsibilities:

· Agile Collaboration: Work with engineers, architects, analysts, and other stakeholders during sprints to clarify requirements, estimate development tasks, participate in code reviews, and deliver assigned features.

· Monitoring & Support: Monitor data pipelines and jobs, investigate failures, resolve production issues, and implement fixes or enhancements as required.

· Deployment & CI/CD: Develop and maintain deployment processes for data solutions, including version control, CI/CD pipelines, environment promotion, and production releases.

· Testing & Debugging: Perform unit testing, integration testing, and debugging of data pipelines and transformations, resolving issues identified during development and deployment.

· Performance Optimization: Troubleshoot and optimize pipelines, queries, notebooks, and Spark jobs to improve performance, scalability, and cost efficiency.

· Data Quality: Implement data validation, error handling, monitoring, and data quality checks to ensure accurate and reliable datasets.

· Integration: Integrate data from multiple sources and systems, ensuring reliable data movement and consistency across development and production environments.

· Lakehouse Development: Develop and maintain Microsoft Fabric Lakehouse and Databricks components, including tables, data models, and data processing workflows.

· Data Engineering: Develop data transformations, notebooks, and processing logic using appropriate technologies such as SQL, Python, PySpark, and Spark.

· Data Pipelines: Build, configure, and optimize ETL/ELT pipelines to ingest, transform, validate, and load data from various sources into the target data platform.

· Development: Design, develop, and maintain scalable data solutions using Microsoft Fabric and Databricks, including data pipelines, lakehouse components, and data transformation workflows.

Working Arrangements

Remote; must be available during Australian Business Hours (AEST). Tools and equipment provided per company policy.

Remuneration & Incentives

·         Remuneration and incentives commensurate with experience.

How to Apply

To be considered, please apply SEEK or [email protected] with the following details:

·         Your expected hourly salary in PHP (Peso)

·         Your experience including a CV

·         Your general availability times and hours on a weekly basis and possible start dates