Python Airflow Developer

Key Job Details

Level :

Employment type : Full Time

About the job

Join Airo Digital Labs and build your career with a leader in emerging digital technologies such as robotic process automation, conversational AI, machine learning, the internet of things, voice-based technologies, and cloud enablement. At Airo, we offer you competitive benefits and compensation packages along with the opportunity to learn on the job, develop knowledge of the process, and grow your career. What’s more, you will have fun as you solve some of the most complex business problems.

Key Responsibilities:

• Design and Develop Airflow DAGs: Create and maintain Airflow DAGs to automate workflows, including ETL processes.
• Task Management: Configure and manage task dependencies, scheduling, retries, and error handling within Airflow.
• Integration: Integrate Airflow with diverse data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).
• Workflow Optimization: Develop efficient workflows for data ingestion, processing, and visualization.
• Data Pipeline Management: Build, maintain, monitor, and orchestrate data pipelines.
• Collaboration: Collaborate with cross-functional teams to understand business requirements and design solutions.
• Technical Support: Provide technical support to team members and resolve technical issues.
• Performance Optimization: Ensure the high performance of data retrieval processes.
• Debugging and Troubleshooting: Debug and troubleshoot applications to ensure high-quality operations.
• Staying Updated: Stay current with the latest technology trends and advancements.

Required Skills:

• Python Proficiency: Strong background in Python programming.
• Airflow Expertise: Experience with Airflow for orchestrating workflows.
• Data Warehouse Concepts: Understanding of data warehouse concepts and ETL tools.
• Database Knowledge: Good understanding of database systems and data architecture.
• SQL Proficiency: Experience working in a SQL environment.
• Version Control: Proficiency with version control systems (e.g., Git).
• Communication and Collaboration: Excellent communication and collaboration skills.

Years of Experience

• 5Yrs Years to 8 Yrs

Key Job Details

Level :

Employment type : Full Time

About the job

Join Airo Digital Labs and build your career with a leader in emerging digital technologies such as robotic process automation, conversational AI, machine learning, the internet of things, voice-based technologies, and cloud enablement. At Airo, we offer you competitive benefits and compensation packages along with the opportunity to learn on the job, develop knowledge of the process, and grow your career. What’s more, you will have fun as you solve some of the most complex business problems.

Key Responsibilities:

• Design and Develop Airflow DAGs: Create and maintain Airflow DAGs to automate workflows, including ETL processes.
• Task Management: Configure and manage task dependencies, scheduling, retries, and error handling within Airflow.
• Integration: Integrate Airflow with diverse data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).
• Workflow Optimization: Develop efficient workflows for data ingestion, processing, and visualization.
• Data Pipeline Management: Build, maintain, monitor, and orchestrate data pipelines.
• Collaboration: Collaborate with cross-functional teams to understand business requirements and design solutions.
• Technical Support: Provide technical support to team members and resolve technical issues.
• Performance Optimization: Ensure the high performance of data retrieval processes.
• Debugging and Troubleshooting: Debug and troubleshoot applications to ensure high-quality operations.
• Staying Updated: Stay current with the latest technology trends and advancements.

Required Skills:

• Python Proficiency: Strong background in Python programming.
• Airflow Expertise: Experience with Airflow for orchestrating workflows.
• Data Warehouse Concepts: Understanding of data warehouse concepts and ETL tools.
• Database Knowledge: Good understanding of database systems and data architecture.
• SQL Proficiency: Experience working in a SQL environment.
• Version Control: Proficiency with version control systems (e.g., Git).
• Communication and Collaboration: Excellent communication and collaboration skills.

Years of Experience

• 5Yrs Years to 8 Yrs