Spark Scala Developer

Job highlights

• 6 to 10 years experience with Spark Scala, expertise in Dataset vs DataFrame API, Spark optimization, and unit testing (JUnit/ScalaTest)
• Develop and optimize Spark applications, manage configurations, handle file formats like Iceberg/Parquet/ORC, and perform packaging and deployment using Spark-submit and Gitlab

JD

Spark Scala Developer

Exp-6 to 10years

location: Pune, Bangalore, Chennai

• Dataset vs Dara frame API
• Read/Write
• File
• JDBC
• Storage
• Iceberg / Parquet
• ORC
• Spark-submit
• Configuration
• Use of Jar files
• Spark Optimisation
• Scala/Java experience
• Packaging
• Unit tests (Junit / ScalaTest)
• Gitlab