SDE - Scala+Spark

Responsibilities

• Lead the design, development, and maintenance of robust, high-performance data processing pipelines and microservices using Scala and Apache Spark.
• Serve as a technical leader and mentor for a team of software engineers, fostering a culture of technical excellence and collaboration.
• Drive architectural decisions and a long-term technology roadmap for our data platform.
• Conduct code reviews and ensure the highest standards of code quality, security, and performance.
• Collaborate with product managers and other engineering leaders to translate business requirements into technical solutions.
• Troubleshoot and resolve complex production issues, ensuring the reliability and scalability of our systems.
• Stay abreast of new technologies and industry best practices, and champion their adoption where appropriate.

Requirements

• 8+ years of experience in software engineering, with a focus on building distributed systems.
• Extensive, hands-on experience with Scala and a strong command of functional programming concepts.
• Expertise in Apache Spark, including Spark SQL, DataFrames, and performance tuning for large-scale data processing.
• Proven experience in a technical leadership role, including mentoring and guiding other engineers.
• Solid understanding of distributed systems architecture, concurrency, and data modeling.
• Proficiency with version control (Git) and CI/CD pipelines.
• Experience implementing RESTful web services in Java, Scala, Python, or similar languages.

This job was posted by Hiring Revrr from Revrr Technologies.