Data Engineer

Role & responsibilities :

Position: Data Engineer

Job Description:

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data platforms. The candidate will work with large datasets, develop ETL/ELT processes, and support data analytics and business intelligence requirements.

Key Responsibilities:

• Design and develop scalable data pipelines and ETL/ELT workflows.
• Develop data ingestion, transformation, and integration processes.
• Work with structured and unstructured data from multiple sources.
• Build and optimize data warehouses, data lakes, and databases.
• Perform data cleansing, validation, and quality checks.
• Optimize SQL queries and data processing jobs for performance.
• Work with cloud data platforms and distributed processing technologies.
• Collaborate with Data Scientists, Analysts, Developers, and Business teams.
• Monitor and troubleshoot data pipelines and production issues.
• Implement data security, governance, and best practices.

Must-Have Skills:

• Strong SQL skills.
• Good experience with Python.
• Experience in ETL/ELT and data pipeline development.
• Knowledge of Data Warehousing concepts.
• Experience with Spark / PySpark.
• Experience with databases such as SQL Server, PostgreSQL, MySQL, or Oracle.
• Knowledge of cloud platforms such as AWS, Azure, or GCP.
• Experience with tools such as Airflow, Databricks, Kafka, or similar technologies.
• Understanding of data modeling and performance optimization.

Good-to-Have Skills:

• AWS: S3, Glue, Redshift, Lambda
• Azure: Data Factory, Synapse, Databricks
• GCP: BigQuery, Dataflow, Cloud Storage
• Kafka / Event Streaming
• Docker / Kubernetes
• CI/CD and Git
• Data Lake / Lakehouse architecture
• Power BI or Tableau exposure