Big Data Development Engineer

Big Data Development Engineer

Openings: 2 Full-Time Positions

Location: Netherlands

I. Responsibilities

1. Develop, schedule, and maintain offline/real-time ETL tasks to ensure the stability and timeliness of data pipelines;
2. Develop and optimize data reports, data service APIs, and data products related to user tags and user profiling;
3. Collaborate with overseas business stakeholders and technical teams to gather requirements and co-develop solutions, participating in communication and delivery for cross-country and cross-regional projects.

II. Qualifications

1. Bachelor’s degree or above in Computer Science or a related field, with at least 3 years of experience in data development using Python and Java;
2. Proficient in SQL, with solid experience in big data warehouse modeling, ETL development, and data reporting development, and able to independently produce technical design and development documentation;
3. Familiar with the Hadoop big data ecosystem, including HDFS, Hive, Spark, Flink, Kafka, etc., with hands-on experience in performance tuning;
4. Good English communication skills, capable of independently participating in international meetings, email communication, and English document reading/writing;
5. Strong communication skills, proactive working attitude, strong sense of responsibility, and good teamwork and stress management abilities.

III. Preferred Qualifications

1. Familiarity with AWS big data ecosystem components, such as EMR, S3, Glue, Athena, Redshift, and other cloud-based data solutions;
2. Experience with Airflow scheduling platforms, Power BI development, and implementation of user tagging and user profiling projects;
3. Experience in data governance and data quality framework development.