Lead Pyspark Developer

We are looking for a skilled Lead Pyspark Developer with 5 to 10 years of experience to join our team at Luxoft India LLP. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark.

Roles and Responsibility

• Design, develop, and deploy large-scale data processing pipelines using Pyspark.
• Collaborate with cross-functional teams to identify business requirements and design solutions.
• Develop and maintain high-quality code that meets performance, security, and reliability standards.
• Troubleshoot and optimize existing data pipelines for improved efficiency.
• Mentor junior developers to enhance their skills and knowledge.
• Participate in code reviews to ensure adherence to coding standards.

Job Requirements

• Strong understanding of big data technologies such as Hadoop and Spark.
• Experience with Pyspark development, including data pipeline design and implementation.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment.
• Strong communication and leadership skills.
• Familiarity with agile development methodologies and version control systems.