Lead Operations

We are looking for an experienced ETL Operations Lead with strong expertise in SQL and Python to manage and lead 24x7 ETL production support operations. The ideal candidate will be responsible for ensuring the stability, availability, and performance of ETL/data pipelines while driving incident management, service improvements, automation, and stakeholder engagement.

Key Responsibilities

• Lead and manage 24x7 ETL production support operations, ensuring high availability and operational stability.
• Act as the primary escalation point for critical production incidents and ensure timely resolution within defined SLAs.
• Perform advanced troubleshooting, debugging, and Root Cause Analysis (RCA) for ETL and data pipeline failures.
• Monitor ETL job failures, data quality issues, system performance, and pipeline bottlenecks.
• Ensure adherence to SLA, KPI, and operational performance targets.
• Proactively identify and implement service improvement and optimization opportunities.
• Drive Incident Management, Problem Management, and Change Management processes.
• Maintain and continuously improve Standard Operating Procedures (SOPs) and operational documentation.
• Create and maintain Knowledge Articles / KEDB (Known Error Database) to support faster incident resolution and knowledge sharing.
• Manage and coordinate with cross-functional teams, including Data Engineering, Infrastructure, Business, and other technology stakeholders.
• Prepare and present governance and operational reports, including SLA compliance, incident trends, job performance, and service metrics.
• Develop and maintain dashboards and reports for operational and management reporting.
• Utilize ServiceNow for incident, problem, and change management activities.
• Perform SQL and PySpark script optimization to improve ETL/data pipeline performance.
• Identify opportunities for automation using Python and scripting to reduce manual effort and improve operational efficiency.
• Ensure consistent adherence to operational processes, documentation standards, and SOPs.
• Collaborate effectively with stakeholders to communicate production issues, risks, progress, and resolutions.
• Required Skills
• Strong experience in Incident, Problem, and Change Management, Strong Root Cause Analysis and troubleshooting skills
• Strong communication and stakeholder management skills
• People Leadership – Capable
• Hands-on experience with PySpark / ETL optimization