spark and scala developer

Job Title: Scala Spark Developer

Location: Toronto, Ontario

Duration: Long Term Contract

HM Notes

We are looking for a Scala Spark Developer to design, develop, and optimize scalable data processing solutions supporting liquidity reporting, analytics, and data quality .

Responsibilities

• Develop and maintain data pipelines using Scala and Apache Spark .
• Build data transformations, aggregations, and calculations for reporting.
• Work with HDFS, Spark, Cassandra, and SQL in large-scale data environments.
• Integrate data from transactional, financial, risk, and other enterprise systems.
• Implement data validation, reconciliation, and error-handling processes.
• Optimize Spark jobs for performance, scalability, and reliability .
• Perform unit testing, code reviews, deployments, and production support.
• Troubleshoot data pipeline and application issues in production.
• Follow enterprise SDLC, security, governance, and development standards .

Required Skills

• Strong hands-on experience with Scala and Apache Spark .
• Strong knowledge of SQL and big data technologies .
• Experience with HDFS and distributed data processing.
• Experience with Cassandra is preferred.
• Strong understanding of data pipelines, ETL, transformations, and data quality.
• Experience working in banking, financial services, risk, or regulatory reporting is a plus.

Preferred

• Experience with liquidity reporting / MRA reporting .
• Experience with Kafka or other streaming technologies .
• Experience supporting enterprise applications in production.