Hiring Big Data Developer - Python/Pyspark - Chennai/Bangalore

Big Data Engineer

Primary Skills Python, Spark,Hadoop, Hive, SQL, Unix Shell Scripting, Airflow or Control M

Exp – 4- 12 Yrs

Location – Tech M Office – Chennai/Bangalore

Job Description

Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.

Well versed with:

• Very good proficiency in Python and Spark programming.
• Pandas: Experience with data manipulation and analysis using Pandas.
• Implementation experience of Spark Core, Spark SQL and Spark Streaming
• Working with Spark in combination Hadoop Ecosystem
• Design and implementation of low-latency, high-availability, and performance applications.
• Should lead and guide a team of junior Python developers.
• As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
• Performance tuning, improvement, balancing, usability, and automation.
• Collaborate with other team members and stakeholders.

Educational Qualification—

• Proficiency in Python programming.
• Experience with Pandas for data manipulation and analysis.
• Knowledge of Polars for efficient data processing.
• Strong problem-solving skills and attention to detail.

Ability to work collaboratively in a team environment