Python Pyspark Developer SIN

Roles and Responsibilities

Job Title: AI / Python PySpark Developer

Experience: 6-8 Years
Location: Bengaluru
Employment Type: Full-Time

Job Description

We are hiring experienced AI / Python PySpark Developers with strong expertise in Data Engineering, Cloud Technologies, and AI-based solutions. The ideal candidate should have hands-on experience in building scalable data pipelines and cloud-native applications using GCP technologies.

Mandatory Skills

• Python
• PySpark
• Artificial Intelligence (AI)
• Google Cloud Platform (GCP)
• BigQuery
• Astronomer (Apache Airflow)
• SQL
• ETL Development
• Data Engineering

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Build and optimize ETL workflows for large-scale data processing.
• Develop cloud-native solutions on Google Cloud Platform (GCP).
• Work extensively with BigQuery for data storage, analytics, and reporting.
• Orchestrate workflows using Astronomer (Apache Airflow).
• Collaborate with business and technical teams to deliver data-driven solutions.
• Ensure performance, scalability, and reliability of data platforms.

Preferred Skills

• GenAI / Machine Learning Concepts
• Data Warehousing
• Cloud Architecture
• CI/CD
• API Development