Data Engineer (Databricks)

Required Technical Skills — Databricks

Unity Catalog — catalogue/schema design, access control, and data lineage

Lakeflow / Delta Live Tables for pipeline orchestration; Delta Lake table format

Databricks SQL and cluster/workspace administration (compute policies, pools, cost management)

Databricks Asset Bundles (DABs) and Databricks Repos for CI/CD

PySpark / Spark SQL for large-scale data transformation

Working knowledge of Databricks system tables (audit logs, billing/usage, query history) for observability

Minimum 5 years of hands-on experience in Data Engineering, Data Platform Engineering, or related disciplines.

Minimum 3 years of hands-on experience with Databricks involving data pipeline development, platform administration, governance, and optimization.

Required Technical Skills — Common

Strong SQL and Python (PySpark or general-purpose) for data engineering

Data modeling — dimensional design, star/snowflake schemas, semantic layers

CI/CD pipelines (e.g., Azure DevOps, GitHub Actions, GitLab CI) for data engineering workflows

Infrastructure-as-code (Terraform preferred) for provisioning cloud data platform resources

Hands-on experience on at least one hyperscaler — AWS, Azure, or Google Cloud

Understanding of data security and compliance frameworks applicable to government/public-sector environments

Aryan Solutions was formed in 2008 in Singapore.

Aryan Solutions is an ISO 9001:2015 (QM), ISO 27001:2013 (IEC) and IEC 15504 (SPICE) Certified IT Consulting, Outsourcing & Staffing Company that specializes in providing IT Consulting, Technology Services, Staffing, Managed Services, Search to Local and Multi-national Companies within APAC, SEA, India & Australia who are leaders in Financial Services, Hedge funds, Asset Management, Telecommunication, Information Technology, Manufacturing, and Government & Public Sector.

Aryan Solutions is headquartered in Singapore with offices in KL (Malaysia), Lucknow (India).

We have a team of highly experienced Consultants working across the Region covering Singapore, USA, UK Malaysia, India, Indonesia, Hong Kong & Australia.

Our offshore development center in India is ISO 9001:2015 (QM) Certified and is a 200 seater plug-and-play office.