Data Engineer

Who you are

• 4+ years of data engineering experience
• Ability to write high-quality code in Python and PySpark
• Strong understanding of database fundamentals and software engineering principles
• Strong understanding of Data Contracts, microservices principles, and treating datasets/platforms as API-driven products
• Deep understanding of two or more of these technologies: Spark, Airflow, AWS EMR, AWS Glue, Sagemaker and Redshift
• Experience with batch processing and streaming systems
• Exposure and/or strong interest in Kafka or other queuing technologies
• A critical thinker and possess creative problem solving skills
• Quantitative skills, ability to think analytically, and strong attention to details
• A desire to contribute to the broader development community
• Don’t meet all the requirements? Studies show women and people of colour are less likely to apply to jobs if they do not meet all the qualifications. Therefore, in an effort to build a more diverse workplace, we encourage you to apply anyways. You might actually be the right person or you may be a good fit for a number of other openings we currently have

What the job involves

• Please note this is a 12-month fixed term contract to backfill a maternity leave
• We are seeking a Data Engineer who is passionate about diving deep into data infrastructure, creating and enhancing data pipelines, and someone who thrives in a product focused environment.
• This role is an important role for our Data Engineering team. The purpose of the Data Engineering team is to empower engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development
• Coordinate with data scientists, data analysts, software engineers and product managers to design and evolve our existing architecture, improving the reliability and performance of our data infrastructure
• Build, maintain and scale our ETL pipelines to help power data science, data products and analytical needs
• Design, build, and maintain data infrastructure systems such as but not limited to AWS DMS, HBase, EMR, Redshift, S3, Kafka, Airflow while ensuring scalability, reliability, and security
• Write new tools, services, and platforms in Python
• Research new technologies to solve tomorrow’s data infrastructure needs
• Advocate for the adoption of tools in the data engineering team

Benefits

• Full health benefits
• Career development & Mentorship opportunities
• RRSP matching
• Generous parental Leave top-up
• Flexible hours
• Regular hackathons
• Healthy snacks & drinks
• Your choice of hardware
• Monthly work-from-home allowance
• Beautiful offices in Toronto and Halifax
• Easy access to transit