Data Engineer

Data Engineer Job Description

Role: Data Engineer
Experience: 5+ Years
Employment Type: Full-Time/C2H
Location: As per project requirement

Role Summary

We are looking for an experienced Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate will have strong experience in data engineering, ETL/ELT, SQL, Python, cloud platforms, and data warehousing.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
• Develop and optimize ETL/ELT workflows to ingest, transform, and load data from multiple sources.
• Work with structured and unstructured data from databases, APIs, files, and enterprise applications.
• Develop efficient and complex SQL queries for data extraction, transformation, and analysis.
• Build data solutions using Python and other relevant data engineering technologies.
• Design and maintain data warehouses, data lakes, and data models.
• Implement data quality, validation, monitoring, and error-handling processes.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Collaborate with Data Scientists, Analysts, Architects, Developers, and business stakeholders.
• Troubleshoot production data issues and ensure timely resolution.
• Implement CI/CD and version-control practices for data engineering solutions.
• Prepare technical documentation and maintain data pipeline specifications.
• Follow data security, governance, and engineering best practices.

Mandatory Skills

• Data Engineering
• Python
• SQL
• ETL / ELT
• Data Warehousing / Data Lakes

Good to Have

• AWS / Azure / GCP
• Spark / PySpark
• Databricks
• Snowflake
• Kafka
• Airflow
• Azure Data Factory / AWS Glue
• Docker / Kubernetes
• Git and CI/CD
• Data Governance and Data Quality

Candidate Profile

• 5+ years of hands-on experience in Data Engineering.
• Strong programming experience with Python.
• Excellent SQL and database knowledge.
• Experience designing and supporting ETL/ELT pipelines.
• Good understanding of data warehouse and data lake architectures.
• Strong analytical, troubleshooting, and communication skills.
• Ability to work effectively in cross-functional and Agile teams.