Data Engineer with AWS + Databricks

Key Responsibilities

Design, build, and operate end-to-end data pipelines (ingestion → transformation → serving) on Databricks and/or Snowflake, following medallion/layered architecture patterns

Configure and administer workspaces/accounts — compute policies, resource sizing, environment setup, and access hierarchy — per the SDP reference architecture

Implement data governance controls: catalogue and schema design, RBAC, row/column-level security, data masking, and lineage tracking

Set up CI/CD and infrastructure-as-code for pipeline deployment and environment promotion (dev → test → prod)

Configure monitoring, telemetry, and audit logging to meet SDP's central observability and security posture requirements

Support UAT, integration testing, and parallel-run validation during migration and go-live

Produce handover documentation (runbooks, access lists, escalation procedures) for agency operations teams

Work directly with GovTech's SDP Central Team, agency stakeholders, and Principal (Databricks/Snowflake) solution architects throughout delivery

Required Technical Skills — Databricks

Unity Catalog — catalogue/schema design, access control, and data lineage

Lakeflow / Delta Live Tables for pipeline orchestration; Delta Lake table format

Databricks SQL and cluster/workspace administration (compute policies, pools, cost management)

Databricks Asset Bundles (DABs) and Databricks Repos for CI/CD

PySpark / Spark SQL for large-scale data transformation

Working knowledge of Databricks system tables (audit logs, billing/usage, query history) for observability

Minimum 5 years of hands-on experience in Data Engineering, Data Platform Engineering, or related disciplines.

Minimum 3 years of hands-on experience with Databricks involving data pipeline development, platform administration, governance, and optimization.

Required Technical Skills — Common

Strong SQL and Python (PySpark or general-purpose) for data engineering

Data modeling — dimensional design, star/snowflake schemas, semantic layers

CI/CD pipelines (e.g., Azure DevOps, GitHub Actions, GitLab CI) for data engineering workflows

Infrastructure-as-code (Terraform preferred) for provisioning cloud data platform resources

Hands-on experience on at least one hyperscaler — AWS, Azure, or Google Cloud

Understanding of data security and compliance frameworks applicable to government/public-sector environments

Preferred Qualifications

Databricks Certified Data Engineer Associate/Professional

SnowPro Core, or SnowPro Advanced: Data Engineer

Prior experience delivering on a government or regulated-sector data platform, or exposure to compliance frameworks such as IM8 is an add o n

Experience working as part of a System Integrator (SI) delivery team alongside a platform Principal is an add on

3 Cubed Business Consulting offers IT Consulting, Solutions and Services to Enterprises in various verticals. Since its inception in 2015, it is Headquartered in Singapore offering solutions that matter.

The company provides comprehensive end-to-end IT solutions to meet the diverse needs of its clients in Asia Pacific region.

We believe in our Customer’s Purpose and we Perform with Passion.

Employment Agency No.: 21S0778