Cloud Data Engineer (f/m/x)

Technologies tools

Must have

Python SQL ETL/ELT Apache Spark/PySpark Microsoft Azure Databricks

Nice to have

Snowflake Apache Kafka Apache Airflow

Do you want to develop your skills in cloud technologies Join our specialized unit focusing on experts in data processing and analysis within the Data Analytics Competency Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.

Your tasks

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions
• Supporting and mentoring less experienced team members, sharing knowledge and best practices

Requirements

• Minimum 4 years of experience in projects related to processing and integrating large volumes of data
• Strong knowledge of SQL and Python
• Experience working with data processing frameworks such as Apache Spark / PySpark
• Practical experience in designing and building Data Lake and Data Warehouse solutions
• Ability to build and maintain ETL/ELT pipelines and work with data orchestration and integration tools
• Commercial experience in cloud-based Microsoft Azure data processing projects (e.g., Databricks, Azure Data Factory, Synapse, Fabric)
• Knowledge of data processing concepts in a distributed environment and optimizing data pipelines
• Ability to communicate fluently in English
• Fluent knowledge of Polish is required
• Required to be located in Poland

Nice to have

• Experience in projects related to data migration from on-premise to cloud (databases: Oracle, PostgreSQL, MS SQL)

Job no. JOB-FUQTP

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.