C
Central Depository Services
Manager & Deputy Manager Pyspark Developer
Skills
SQL QueriesBig DataPythonPySpark
3 years ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Permanent
Location:
Mumbai, Maharashtra, India
Work mode:
Onsite
Published on:
13 October 2026
What they need
Having experience 4-5 years
Having experience 2-3 years - Strong expertise in Big Data ecosystem like Spark, Hive, Sqoop, HDFS, Map Reduce, Oozie, Yarn, HBase, Nifi.
- Design, develop, and maintain PySpark data processing pipelines to process large volumes of structured and unstructured data.
- Collaborate with data engineers and data scientists to understand data requirements and design efficient data models and transformations.
- Optimize and tune PySpark jobs for performance, scalability, and reliability.
- Implement data quality checks, error handling, and monitoring mechanisms to ensure data accuracy and pipeline robustness.
-Develop and maintain documentation for PySpark code, data pipelines, and data workflows.
-Developed production ready Spark applications using Spark RDD apis, Data frames, Datasets, Spark SQL and Spark Streaming.
-Strong experience of HIVE Bucketing and Partitioning.
-Well versed in writing complex hive queries using analytical functions.
-Knowledge in writing custom UDFs in Hive to support custom business requirements.
Job Description : - We are looking for a skilled PySpark Developer having 4-5 or 2-3 years of experience to join our team.
- As a PySpark Developer, you will be responsible for developing and
- maintaining data processing pipelines using PySpark, Apache Sparks Python API.
- You will work closely with data engineers, data scientists, and other stakeholders to design and implement scalable and efficient data processing solutions.
Other offers great for you!
These companies are also looking for great profiles
L
LeHibou
IT Application & Project Manager - Œnology Delivery & Solution Deputy
480€ / jour
Freelance
Épernay, France
Hybrid
Skills
CybersecurityITIL
4 days ago
Quick apply
N
Nexoris
Business Developer
Permanent contract
Remote
Skills
Business Development
1 hour ago
Quick apply
V
Visian
Incident Manager
Freelance
Paris, France
Onsite
Skills
Incident managementRoot cause analysisClaims managementCSDROperational process optimizationData quality management
1 hour ago
Quick apply