Junior ETL Data Engineer

Key Responsibilities

• Pipeline Development: Design and implement scalable ETL/ELT workflows to ingest data from various sources (databases, flat files) into our data warehouse and big data environments.
• Develop and maintain automation scripts using Python and Shell (Linux) to streamline data validation, monitoring, and system maintenance.
• Data Modeling & Optimization: Write complex, high-performance SQL queries and manage database schema designs to support analytical requirements.
• Infrastructure Support: Manage and troubleshoot data services hosted on Linux-based virtual machines and cloud platforms.
• Big Data Management: Utilize Hadoop ecosystem tools to process and manage large-scale distributed datasets.
• Collaboration: Work closely with stakeholders to translate business requirements into technical data solutions and detailed architectural documentation.

Technical Qualifications

• ETL/ELT Proficiency: Minimum 2-3 years of experience in data integration, with hands-on expertise in enterprise-grade integration tools or custom-built frameworks.
• Advanced SQL: Deep knowledge of SQL for data transformation, window functions, and performance tuning.
• Data Migration: Experience managing large-scale data migrations.
• Willing to work on 10-months contract.
• Able to start immediately