Data Engineer

We are looking for a skilled Data Engineer with 3+ years of experience to design, build, and maintain scalable data pipelines and data platforms. The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure high-quality, reliable, and performant data solutions.

Key Responsibilities

• Design, develop, and maintain end-to-end ETL/ELT data pipelines
• Build and optimize data ingestion frameworks from multiple sources (APIs, databases, files, streaming
• Work with data warehouses and lakehouse architectures (Snowflake, Redshift, BigQuery, Databricks, etc.)
• Develop and maintain batch and near-real-time pipelines
• Ensure data quality, validation, monitoring, and observability
• Optimize SQL queries and data models for performance and scalability
• Collaborate with analytics, BI, and ML teams to support reporting and advanced analytics
• Implement data governance, security, and access controls
• Automate workflows using orchestration tools (Airflow, Luigi, etc.)
• Troubleshoot and resolve data pipeline and production issues

Required Skills & Qualifications

Must-Have

• 3+ years of hands-on experience as a Data Engineer
• Strong proficiency in Python and SQL
• Experience with ETL/ELT pipeline development
• Hands-on experience with data warehouses (Snowflake preferred)
• Experience with Apache Airflow or similar orchestration tools
• Strong understanding of data modeling (star/snowflake schemas)
• Experience working with large-scale datasets
• Familiarity with Git-based version control
• Experience working in agile environments

Good to Have

• Experience with Apache Spark / PySpark
• Exposure to Kafka or streaming platforms
• Knowledge of cloud platforms (AWS / Azure / GCP)
• Experience with Docker & Kubernetes
• Familiarity with data quality frameworks (Great Expectations, Soda, etc.)
• BI tools experience (Power BI, Looker, Tableau)
• Infrastructure-as-Code tools (Terraform, CloudFormation)
• CI/CD pipelines for data workflows

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.