Python Developer

Job Overview

We are seeking an experienced Python Developer – Data Engineering to join our data engineering team. The successful candidate will design, develop, and maintain high-performance data processing pipelines using modern Python frameworks and technologies.

The role involves working with large-scale datasets, containerized applications, distributed computing platforms, analytical databases, and event-driven architectures.

Key Responsibilities

• Develop and optimize data processing workflows using Python.
• Work with Pandas and Polars to manipulate, transform, and analyze large datasets.
• Design and implement containerized applications using Docker and Kubernetes.
• Build and maintain data pipelines integrating with ClickHouse and similar analytical databases.
• Develop event-driven architectures using NATS messaging systems.
• Write comprehensive unit and integration tests using Pytest.
• Implement distributed computing solutions using Dask.
• Optimize data processing workflows for performance and scalability.
• Maintain source code using Git and follow collaborative development practices.
• Participate in code reviews and contribute to engineering best practices.

Required Skills & Experience

• Advanced proficiency in Python.
• Strong hands-on experience with Pandas and Polars.
• Experience optimizing Python applications for large-scale data processing.
• Hands-on experience with Docker.
• Working knowledge of Kubernetes.
• Experience with ClickHouse or similar columnar/OLAP databases.
• Familiarity with NATS.io or similar messaging and streaming technologies.
• Strong experience with Pytest.
• Experience with Dask for distributed and out-of-core computing.
• Strong knowledge of Git, branching strategies, and collaborative development workflows.

Preferred Qualifications

• Experience with additional Python libraries used in data science and machine learning.
• Familiarity with CI/CD pipelines and DevOps practices.
• Experience working with large-scale data platforms.
• Financial services or capital markets data experience.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Pay: $40.00-$45.00 per hour

Work Location: Hybrid remote in Toronto, ON (Toronto District)