Data lake Support Associate II – PHL

Required Qualifications

• 3-5 years of experience
• Highly preferred: Hands-on expertise with PySpark.
• Experience working with SQL and relational databases.
• Familiarity with ETL/ELT processes and data pipeline troubleshooting.
• Knowledge of cloud-based data platforms (Azure, AWS, or GCP) is an advantage.
• Experience with distributed data processing frameworks such as Apache Spark.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication skills with the ability to work effectively in a global team.

Preferred Skills

• PySpark (Highly Preferred)
• Apache Spark
• SQL
• Python
• Data Lake technologies
• ETL/ELT Support
• Incident Management
• Data Quality Monitoring
• Cloud Data Platforms (Azure, AWS, or GCP)

Key Responsibilities

• Monitor, maintain, and support enterprise data lake environments and data pipelines.
• Troubleshoot and resolve issues related to data ingestion, transformation, and processing.
• Analyze production incidents and perform root cause analysis to prevent recurring issues.
• Support ETL/ELT workflows and ensure data integrity, quality, and availability.
• Collaborate with data engineers and cross-functional teams to implement fixes and enhancements.
• Optimize data processing jobs for performance and reliability.
• Monitor system health, logs, and batch processes to ensure smooth daily operations.
• Document support procedures, issue resolutions, and technical knowledge.
• Participate in incident management and provide timely resolution of production issues.
• Ensure adherence to data governance, security, and operational best practices.