Data Engineer (Databricks/AWS)

About the role

As a Data Engineer, you will play a crucial role in designing, building, and maintaining robust data infrastructure and pipelines that support our organization's data-driven initiatives. You will work with cutting-edge technologies including Databricks and AWS to create scalable solutions that enable better business insights and decision-making across the company.

Key responsibilities

• Design and develop data pipelines and ETL processes using Databricks and AWS services to extract, transform, and load data from various sources
• Build and maintain scalable data architectures on AWS, ensuring optimal performance, security, and cost-efficiency
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions
• Implement data quality frameworks and monitoring systems to ensure accuracy and reliability of data across platforms
• Optimise data processing workflows and improve system performance through code reviews and continuous refinement
• Manage data governance policies and ensure compliance with data security and privacy standards
• Troubleshoot and resolve data infrastructure issues promptly to minimise disruption to business operations
• Document technical specifications, architecture decisions, and operational procedures for knowledge transfer and maintenance
• Stay current with industry best practices and emerging technologies in data engineering and cloud platforms

What we're looking for

• Proven experience working with Databricks and AWS (or equivalent cloud platforms) in a production environment
• Strong proficiency in programming languages such as Python, Scala, or Java
• Solid understanding of data warehouse concepts, dimensional modelling, and relational database design
• Experience with distributed data processing frameworks and big data technologies (e.g., Apache Spark, Hadoop)
• Familiarity with SQL and ability to write complex queries for data analysis and validation
• Knowledge of data pipeline orchestration tools (e.g., Apache Airflow, AWS Glue, or similar)
• Understanding of data security, governance, and compliance principles
• Excellent problem-solving skills and ability to troubleshoot complex technical issues
• Strong communication skills and ability to collaborate effectively with cross-functional teams
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent professional experience
• Preferred: Experience with machine learning platforms and integration of ML models into data pipelines
• Preferred: Certification in AWS or Databricks (e.g., AWS Certified Data Analytics - Specialty)

What we offer

At NCS Philippines, we are committed to fostering a dynamic and inclusive workplace where innovation thrives. We provide competitive remuneration packages aligned with industry standards, professional development opportunities to enhance your technical and leadership skills, and a collaborative working environment that values diverse perspectives. Our flexible work arrangements support work-life balance, and we offer comprehensive health and wellness benefits including medical coverage and wellness programmes. You will have access to the latest technologies and tools to perform your role effectively, and opportunities to grow your career through internal mobility and training initiatives. We believe in investing in our people and creating pathways for long-term career progression.