Vortech Service Company Limited

Job Summary:
For one of our clients, we are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have a solid background in data engineering, with expertise in Python, ETL tools, Airflow, and Hadoop. You will be responsible for building, maintaining, and optimizing data pipelines that handle high-volume transactions exceeding 50 million per day.
If you're excited about solving challenging problems, delivering polished user experiences, and contributing to a fast-paced and innovative environment, we’d love to meet you.
Key Responsibilities:
<ul>
<li>Design, develop, and maintain scalable data pipelines and data models for large transaction systems.</li>
<li>Utilize Python and ETL tools to extract, transform, and load data efficiently from various sources.</li>
<li>Implement and manage workflows using Apache Airflow to automate data processing tasks.</li>
<li>Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and availability.
Optimize data processing performance and reliability in a Hadoop environment.- Monitor and troubleshoot data pipeline issues to ensure operational efficiency and reliability.
Document processes, data flow, and architecture for future reference and compliance.- Stay current with industry trends and emerging technologies in data engineering.</li>
</ul>
<h2>Your skills and experience</h2>
MUST HAVE
<ul>
<li>5+ years of experience in data engineering role.</li>
<li>Strong proficiency in Python for data processing and manipulation.</li>
<li>Hands-on experience with ETL tools (e.g., Talend, Informatica, Apache NiFi).</li>
<li>In-depth knowledge of Apache Airflow for workflow management.</li>
<li>3+ years of hands-on experience with Spark</li>
<li>Strong experience working with Kafka/Flink</li>
<li>Experience with big data technologies such as Hadoop and its ecosystem (e.g., HDFS,</li>
<li>Proven experience in building and maintaining big transaction systems (handling over 50 million transactions per day).</li>
<li>Familiarity with cloud platforms (e.g., AWS, Azure, GCP) is a plus.</li>
<li>Excellent analytical and problem-solving skills.</li>
<li>Strong communication skills and the ability to work collaboratively in a team environment.</li>
</ul>
<h2>Why you'll love working here</h2>
<ul>
<li>A supportive and flexible working environment</li>
<li>Macbook provided</li>
<li>Premium health insurance</li>
<li>SHUI contributions which comply with local laws</li>
<li>13th month salary</li>
<li>15 paid annual leaves per year</li>
<li>Work from home 3 days/month</li>
<li>Company trip, happy hour, snack and coffee</li>
</ul>

Senior Data Engineer (Python, ETL)

Senior Data Engineer (Python, ETL)

This job is no longer available

Talents

Recruiters

About