Python/PySpark developer and Data Engineer

Project description

We are looking for a senior Python developer to join our client's team and lead the build of a new data and application platform. The team focuses on clean code, agile methodologies, and high-quality delivery. The client is from the investment banking industry.

Responsibilities

Design, develop, and maintain scalable back-end services and APIs using Python

Build and optimize data pipelines and workloads on Databricks

Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps

Advise and guide the team on architecture, design decisions, and best practices while the new platform is built

Mentor developers and raise the technical level of the team through code reviews and pair programming

Define and consume RESTful APIs, clearly communicating requirements and constraints across teams

Translate business and product requirements into robust technical solutions

Apply clean code principles and contribute to continuous improvement of engineering standards and tooling

Write and maintain automated tests (unit, integration)

Participate actively in agile ceremonies (Scrum/Kanban), including refinement, planning, reviews, and retrospectives

Work closely with QA, product managers, and architects to ensure high-quality, business-aligned deliveries

Support and improve existing applications in a fast-paced, enterprise investment-banking environment

Must have

At least 8 years of professional software development experience, including long-term projects

Strong hands-on Python development skills

Hands-on experience with PySpark and distributed data processing

Proven experience designing, building and maintaining ETL pipelines

Hands-on experience with Databricks

Experience in automated testing of data pipelines and applications

Clean coding skills

Excellent problem-solving skills

Familiarity with agile practices (Scrum, Kanban, etc.)

Good communication skills and the ability to state requirements clearly to other teams

Nice to have

Hands-on experience with Oracle, including strong SQL skills and query and performance tuning

Good working knowledge of Unix/Linux and shell scripting

Experience scheduling and monitoring batch jobs with Autosys

Background in Java or C# development

Languages

English: C1 Advanced