Data Engineer Multiple Openings

Role & responsibilities

• Design, build and maintain scalable batch and real-time data pipelines (ETL/ELT)
• Develop data models and data warehouse or lakehouse solutions
• Work with large, complex datasets from multiple sources
• Optimise pipeline performance, reliability and cost
• Ensure data quality, governance and security
• Collaborate with analysts, data scientists and business teams

Required Skills

• Strong SQL and Python (or Scala)
• Hands-on PySpark / Apache Spark
• Experience with at least one cloud: Azure (ADF, Databricks, Synapse), AWS (Glue, EMR, Redshift) or GCP (BigQuery, Dataflow)
• Data warehousing concepts: dimensional modelling, star/snowflake schemas
• Orchestration tools such as Airflow or ADF

Good to Have

• Databricks, Snowflake, Delta Lake
• Kafka / streaming
• dbt, CI/CD for data pipelines
• Cloud data certifications

Preferred candidate profile