Walking Tree
Opening For Data Engineer@Walkingtree Tech
Skills
1 month ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Permanent
Location:
Kolkata, West Bengal, India
Work mode:
Onsite
Published on:
23 September 2026
What they need
Must Have Skills:-
Python, Pyspark, AWS-Glue, Data Lke, Delta Lake
Key Roles and Responsibilities:
-Design and build ETL/ELT pipelines using Python and PySpark
-Process large-scale structured and semi-structured data (CSV, JSON, Parquet, Avro)
-Ensure pipelines are efficient, fault-tolerant, and scalable
-Develop distributed data transformations using PySpark DataFrames and Spark SQL
-Optimize Spark jobs (partitioning, caching, broadcast joins)
-Handle batch and (optionally) streaming data using Spark Structured Streaming
-Design data lake and data warehouse schemas (star, snowflake)
-Implement partitioning and file formats for performance (Parquet, ORC)
-Maintain data quality, consistency, and integrity
-Schedule and orchestrate pipelines using tools like:
-Apache Airflow, AWS Step Functions, or AWS Glue Workflows
-Automate data ingestion from APIs, databases, and streaming sources
Other offers great for you!
These companies are also looking for great profiles
Groupbees
Tech Lead Fullstack Python/Java/Next.js
550€
Freelance
92400 Courbevoie, France
Hybrid
Top Recruiter
Skills
15 hours ago
Quick apply
ECARIS
Data Analyst BI senior
Freelance
Paris, France
Hybrid
Skills
11 hours ago
Quick apply
Soors
Data Engineer H/F
Freelance
Paris, France
Hybrid
Skills
2 hours ago
Quick apply