Airflow & Python Data Engineer

Develop and maintain Apache Airflow workflows and Python-based data pipelines. The role covers workflow orchestration, ETL/ELT development, data integration, performance optimization, monitoring, and CI/CD support within an Agile environment.

Key Responsibilities

• Build and maintain Airflow DAGs for reliable workflow orchestration.
• Develop and support Python-based ETL/ELT pipelines and data integrations.
• Work with APIs, databases, files, Kafka, and MQ.
• Monitor, troubleshoot, and optimize pipeline performance.
• Support version control and CI/CD practices.
• Collaborate within an Agile environment.

Required Skills and Experience

• Strong Python development skills, including writing clean, modular, and testable code.
• Proven experience building and maintaining Apache Airflow DAGs.
• Solid understanding of workflow orchestration, scheduling, and dependencies.
• Experience with ETL/ELT pipelines and data integration.
• Familiarity with Git, CI/CD practices, monitoring, troubleshooting, and performance optimization.