Data Engineer

About Albany Beck

Albany Beck is a consultancy specialising in delivering high-quality change, technology, data and regulatory solutions across financial services. We partner with leading banks, asset managers, insurers and other financial institutions to provide experienced consultants who can support complex business and transformation programmes.

Client Deployment Role Description

We are looking for an experienced Data Engineer to work with us here at Albany Beck, supporting one of our major banking clients within its Commercial Banking Data Technology function. Based in Kraków, Poland, this is a hybrid position requiring approximately 6 days per month in the office.

The successful candidate will join a cross-functional data team responsible for designing, developing and optimising data engineering solutions across multiple business and technology value streams.

The role requires a hands-on Data Engineer with strong programming capability and practical experience developing scalable data pipelines using technologies including Scala, Python and Apache Spark. Strong experience with Google Cloud Platform (GCP), particularly BigQuery, will also be important.

The successful candidate will contribute to wider data transformation, analytics and data quality initiatives while working closely with technical teams and UK-based stakeholders.

Key Responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Scala, Python and Apache Spark.
• Build and optimise data processing solutions within Google Cloud Platform (GCP), particularly BigQuery.
• Develop and maintain data integration processes across multiple data sources and enterprise platforms.
• Write efficient, maintainable SQL queries to support data transformation, validation and reporting requirements.
• Ensure data pipelines meet required performance, scalability, reliability and data quality standards.
• Work closely with data architects, data modellers, analysts and business stakeholders to translate requirements into effective technical solutions.
• Apply software development lifecycle (SDLC) best practices across version control, testing, documentation and deployment.
• Troubleshoot data processing and pipeline issues and identify opportunities to improve existing data engineering solutions.
• Contribute to the development of reusable data engineering frameworks, standards and best practices.
• Collaborate effectively across distributed technology teams and with UK-based stakeholders.

Key Skills & Experience

• Strong hands-on programming experience with Scala and/or Python.
• Proven commercial experience using Apache Spark for large-scale data processing.
• Strong experience working with Google Cloud Platform (GCP), including BigQuery.
• Strong SQL skills, including query development, data transformation and optimisation.
• Demonstrable experience designing, developing and implementing ETL/ELT processes and scalable data pipelines.
• Experience working with large, complex datasets and enterprise-scale data platforms.
• Good understanding of software development lifecycle processes and modern engineering best practices.
• Experience integrating data across multiple sources, platforms and systems.
• Strong analytical, troubleshooting and problem-solving capabilities.
• Ability to collaborate effectively across cross-functional and geographically distributed teams.

Desirable Experience

• Previous experience within Financial Services, ideally Commercial or Corporate Banking.
• Experience working with cloud-based data architectures and modern enterprise data platforms.
• Knowledge of data governance, data quality and regulatory requirements.
• Experience with CI/CD pipelines and automated testing.
• Experience working within Agile delivery environments.
• Experience working within large, complex enterprise technology environments.