Data Engineer

Join us as a Data Engineer and take part in the development and maintenance of data flows serving Data Analytics related international projects.

Your responsibilities will include

• Designing, implementing, testing, and optimizing reliable, efficient, and high-quality data pipelines
• Automating the extraction, loading and transformation of data from a wide variety of sources
• Developing solutions for the automated acquisition of data from source systems
• Ensuring compliance with data security standards and guidelines
• Analyzing data flows and processes to identify opportunities for improvement
• Collaborating with project teams and business stakeholders primarily across Europe, with interaction with colleagues based in India
• Identifying and evaluating data provisioning capabilities across various source systems and technologies
• Analyzing data and investigate data quality issues in close collaboration with business stakeholders
• Maintaining, troubleshooting, and continuously improving existing data pipelines

You are looking for us, if you have

• Have a proven track record of building data sets and data pipelines for analytical use cases
• Are proficient in Python, PySpark, and SQL; experience with additional programming languages such as JavaScript, Scala, Java, and shell scripting (Bash, Ksh, Sh) is an advantage
• Have expert-level experience in building and optimizing data lakes, distributed data processing solutions, and data pipelines, particularly using Apache Spark
• Have hands-on experience with the Azure data ecosystem, including Databricks and Azure Data Factory
• Possess strong knowledge of common data formats, including JSON, XML, Parquet, and CSV
• Have excellent analytical skills and architectural expertise to select the most appropriate technology for each use case
• Have a strong understanding of non-functional requirements, including performance, data quality, and security
• Have experience working with relational databases and advanced SQL skills
• Have experience with deployment automation, testing, CI/CD practices, and the setup of monitoring, alerting, and logging for data platforms and services
• Are fluent in spoken and written English

You will be successful if you

• Have hands-on experience with the technology stack described above
• Possess strong analytical skills and are able to work with unstructured or incomplete data and information
• Enjoy taking ownership and working on projects with a high level of responsibility
• Have a solution-oriented mindset
• Can work autonomously and proactively close information gaps in collaboration with project teams and business stakeholders
• Are open-minded, proactive, and able to work independently in a dynamic environment

What we are proud to provide you with

• Hybrid working with even only weekly 2 office days and flexible working hours based on core time.
• Financial benefits such as; an outstanding amount of cafeteria, referral reward and team or individual reward based on your accomplishments.
• Corporate health insurance package at one of the largest private healthcare providers with nationwide coverage.
• Carefully designed career paths, with the appropriate training courses and projects to accomplish your aims such as language courses, tech talks and trainings for your needs.
• Lufthansa Group flight ticket discounts.
• What’s more, if you are interested in our additional benefits: check out our benefits page.

Our community is characterized by mutual respect and a spirit of helpfulness. This high level of professionalism, combined with diverse personalities, will help you go through your daily life in a good mood while making the most of your skills and talents.

In addition to an inclusive and helpful atmosphere, trust is also an important value for us. You can rely on us with anything right from your first day, and we also trust you to the utmost extent.

Are you ready to fly with us? Apply now!