Senior Data Engineer (Databricks, PySpark & Big Data Pipelines)

Senior Data Engineer (Databricks, PySpark & Big Data Pipelines)

• Job ID / Requisition ID: R0148413
• Location: Ho Chi Minh City, Vietnam
• Company: Hitachi Digital Services

About the Role

Fuel machine learning and operational intelligence at enterprise scale. Hitachi Digital Services is hiring a Senior Data Engineer to join our Data Science team, building scalable data pipelines, optimizing big data workflows, and engineering reusable datasets on Databricks.

Key Responsibilities

• Pipeline Engineering: Design, build, and maintain high-throughput batch and streaming data pipelines within Databricks.
• Analytics & Feature Engineering: Transform raw telemetry into curated data tables and feature stores to power advanced Data Science and ML models.
• Query Optimization: Diagnose data anomalies, fine-tune SQL queries, and optimize PySpark processing logic for performance and scalability.
• Orchestration & Streaming: Manage data workflows using Airflow and ingest large-scale event streams using Kafka.
• Collaborative Delivery: Partner closely with Data Scientists and engineering stakeholders to productionize analytical pipelines in an Agile environment.

Qualifications

• Strong experience building production data platforms using Databricks.
• Deep technical proficiency in PySpark, Python (Pandas), and advanced SQL.
• Hands-on familiarity with workflow orchestration (Airflow) and event streaming (Kafka).
• Experience handling large-scale datasets, data modeling, and performance tuning.
• Nice to have: Exposure to Delta Lake, Flink, containerization (Docker, Kubernetes), or Azure Data platforms.
• Good communication and stakeholder collaboration skills.

Key Benefits

• 14 months' salary per year.
• 100% salary-based Social Insurance & $3,000/year Private Insurance.
• Hybrid work & Online interviews.
• 14+ days of Annual Leave.
• International onsite opportunities.

Job Type: Full-time

Pay: Up to 90,000,000₫ per month

Work Location: Hybrid remote in Thành phố Hồ Chí Minh