Spark and Scala Developer

Job Title: Spark with Scala Developer (Java Background)

Location: Toronto, Canada

Duration: Long Term Contract

Job Summary

We are looking for an experienced Spark with Scala Developer with a strong Java background to design, develop, and optimize large-scale data processing applications. The ideal candidate will leverage their Java expertise and transition seamlessly into Scala-based Spark development, building high-performance, scalable, and reliable data solutions.

Key Responsibilities

• Design and develop big data applications using Apache Spark and Scala.
• Build and optimize ETL/data processing pipelines for large datasets.
• Develop scalable, high-performance solutions on distributed data platforms.
• Utilize Java expertise to enhance Spark applications and integrate existing Java libraries.
• Troubleshoot performance issues and optimize Spark jobs.
• Work closely with data engineers, architects, and business stakeholders.
• Ensure code quality through testing, code reviews, and best practices.
• Participate in system design, performance tuning, and production support.

Required Skills

• 5+ years of software development experience.
• Strong hands-on experience with Java development.
• Experience with Apache Spark and Scala.
• Good understanding of distributed computing concepts.
• Knowledge of JVM internals, memory management, and performance tuning.
• Experience with SQL and large-scale data processing.
• Familiarity with Hadoop ecosystem and cloud platforms is a plus.
• Strong problem-solving and analytical skills.

Preferred Qualifications

• Experience with Databricks, Kafka, or streaming technologies.
• Exposure to AWS, Azure, or Google Cloud platforms.
• Knowledge of CI/CD, Git, and Agile methodologies.