Big Data Lead/ Architect (Spark, PySpark & SQL)

Job highlights

• Bachelor s or Master s degree in Computer Science or a related field.
• Relevant Big Data certifications preferred. . Disclaimer : This job posting has been aggregated from external source
• Collaborate with business stakeholders,data engineers,and analysts for requirement gathering and solution delivery.
• Experience Required
• Preferred Qualifications

Key Responsibilities

• Architect and implement scalable Big Data solutions using Hadoop technologies.
• Design and optimize Spark/PySpark-based data processing pipelines.
• Perform performance tuning of Spark jobs and SQL queries.
• Design and manage ETL/data integration workflows.
• Ensure scalability, reliability, and security of data platforms.
• Collaborate with business stakeholders, data engineers, and analysts for requirement gathering and solution delivery.
• Oversee Hadoop cluster architecture and resource optimization.
• Maintain technical documentation and architecture standards.
• Mentor team members and provide technical leadership.
• Drive continuous improvements and best practices across data platforms.

Experience Required

• 10+ years of overall IT experience.
• 5+ years of relevant experience in Big Data Architecture.

Preferred Qualifications

• Bachelor s or Master s degree in Computer Science or a related field.
• Exposure to AWS, Azure, or GCP is an added advantage.
• Relevant Big Data certifications preferred.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.