Big Data & Python Support Consultant

Freelancing Opportunity

Job Description: Big Data & Python Support Consultant

Experience: 4–8 Years

Job Summary

We are looking for an experienced Big Data & Python Support Consultant with strong hands-on expertise in Python, PySpark, Apache Hive, Advanced SQL, and Linux. The consultant will be responsible for development, debugging, troubleshooting, and supporting daily sprint activities in a Big Data environment.

Key Responsibilities

• Develop, debug, and optimize Python and PySpark scripts.
• Write and troubleshoot complex SQL queries and Hive scripts.
• Support ETL pipelines and large-scale data processing.
• Troubleshoot production issues, logs, and performance bottlenecks.
• Work with Linux/Unix environments and shell scripting.
• Handle sprint tickets, defect resolution, and technical support.
• Leverage AI development tools such as Cursor, Claude, and GitHub Copilot.

Required Technical Skills

• Python: Strong programming, scripting, and debugging.
• Apache Spark / PySpark: Distributed data processing and optimization.
• Apache Hive: HiveQL, data transformations, and troubleshooting.
• Advanced SQL: Complex joins, CTEs, window functions, and query tuning.
• Linux/Unix: Shell scripting, command-line operations, and log analysis.
• Big Data: HDFS, ETL pipelines, and distributed computing.
• AI Tools: Familiarity with Cursor, Claude, or GitHub Copilot.

Mandatory Requirements

• 4–8 years of relevant Big Data Engineering experience.
• Strong hands-on experience with Python, PySpark, Hive, SQL, and Linux.
• Ability to independently troubleshoot and resolve technical issues.
• Experience supporting agile sprint activities and production environments.
• Good communication and problem-solving skills.
• Reliable internet connection and remote working setup.

Ideal Candidate: Big Data Engineer / PySpark Developer / Python Data Engineer with strong development and production support experience.

Pay: ₹30,000.00 - ₹40,000.00 per month

Education:

• Bachelor's (Required)

Experience:

• Big data: 8 years (Required)

Shift availability:

• Night Shift (Required)
• Overnight Shift (Required)

Work Location: Remote