Python and Pyspark Developer ( Strictly no Data Engineer )

Role & responsibilities

Job Title: Python + PySpark Developer (Not Data Engineer Profile)

Max Notice Period 30days and Exp 6+ Years

Experience: 6+ Years
Location: Pune / Bangalore / Chennai / Hyderabad
Notice Period: Immediate to 30 Days Preferred

Job Summary

We are seeking an experienced Python + PySpark Developer with 6+ years of hands-on development experience in building scalable data processing applications and backend solutions. The ideal candidate should have strong expertise in Python programming, PySpark development, SQL, and distributed data processing. This role is focused on application development using Python and PySpark and is not a Data Engineer position.

Key Responsibilities

• Design, develop, and maintain Python and PySpark-based applications.
• Build scalable data processing and transformation solutions using PySpark.
• Develop reusable, efficient, and optimized Python code.
• Write complex SQL queries for data extraction, transformation, and analysis.
• Collaborate with business stakeholders and technical teams to understand requirements.
• Perform code reviews and ensure adherence to coding standards and best practices.
• Troubleshoot and optimize application performance.
• Work in Agile/Scrum environments and participate in sprint ceremonies.
• Develop and maintain technical documentation.

Required Skills

• 6+ years of experience in Python Development.
• Strong hands-on experience with PySpark.
• Expertise in Core Python programming concepts.
• Strong SQL and database development experience.
• Experience in data transformation, processing, and optimization using PySpark.
• Good understanding of Spark architecture and distributed computing.
• Experience with Linux/Unix environments.
• Strong debugging and problem-solving skills.
• Knowledge of Object-Oriented Programming (OOP) and Design Patterns.
• Experience working with Git version control.

Good to Have

• Experience with Spark SQL and DataFrames.
• Exposure to AWS, Azure, or GCP cloud platforms.
• Experience with Airflow for workflow orchestration.
• Knowledge of REST API development using Python.
• Familiarity with Docker and Kubernetes.
• Basic understanding of CI/CD pipelines.

Qualifications

• Bachelor's Degree in Computer Science, Information Technology, or a related field.
• Strong communication and stakeholder management skills.

Budget

20-25 LPA (Based on experience and interview performance)

Keywords

Python Developer, PySpark Developer, Python, PySpark, Spark SQL, SQL, Distributed Computing, Data Processing, Backend Development, Linux, Git, OOP, Agile, AWS, Azure, GCP.

Preferred candidate profile

Interested Candidates Share your cv or Reference on - Refer your friends and Colleagues on [email protected]