Data Engineer

Job Summary

As a Data Engineer, you will be fully responsible for all the data pipelines with PII info (customer email address). The ideal candidate should have a strong background working with data lake platforms (preferably GCP or GBQ or equivalent) with experience of ETL development and data pipeline set-up and data warehouse layers.

Responsibilities

• Set up ETL pipelines to load data from various domains using API, Cloud SQL, scripts, FTP/SFTP etc.

• Collaborate with business analysts and product owners to understand data requirements.

• Optimize query performance to enhance data warehouse responsiveness.

• Lead the design, development, and deployment of data warehouse solutions for those datasets containing PII info.

• Develop and maintain documentation for the data warehouse, including data dictionaries and technical specifications.

• Monitor data warehouse performance and capacity, performing necessary optimizations and upgrades.

  Requirements

• Bachelor's degree in Computer Science or a related field and high level of English proficiency.

• A minimum of 2 years of experience in data pipeline and data warehouse management.

• Strong knowledge of GCP and GBQ.

• Strong knowledge of data warehouse modeling, concepts, and SQL.

• Proficiency in scripting languages such as Python is preferred.

• Experience with agile working processes.

• Familiarity with the DevOps lifecycle and CI/CD pipelines, GitHub, Bitbucket.

  Location

Hyderabad, Nederland

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.