Data Engineer

Data Engineer Python | SQL | ETL | Cloud

Company: Spark Techwave InnovationZ Pvt Ltd
Job Type: Full-Time
Experience: 1–15 Years
Location: Chennai / Remote / Hybrid
Department: Data & Engineering

Job Summary

Spark Techwave InnovationZ Pvt Ltd is looking for a Data Engineer to design, build, and maintain scalable data pipelines and data-processing solutions.

The ideal candidate should have strong knowledge of Python, SQL, ETL/ELT concepts, databases, and data pipeline development. Experience with cloud platforms and modern data engineering tools will be an advantage.

Key Responsibilities

• Develop and maintain reliable data pipelines and ETL/ELT workflows.
• Extract, transform, and load data from multiple sources.
• Write efficient SQL queries for data extraction, transformation, and analysis.
• Develop data-processing solutions using Python.
• Work with relational and/or NoSQL databases.
• Perform data validation, quality checks, and troubleshooting.
• Optimize data pipelines for performance, scalability, and reliability.
• Collaborate with Data Analysts, Data Scientists, Software Engineers, and other stakeholders.
• Monitor pipeline execution and resolve data-related issues.
• Document data pipelines, processes, and technical solutions.
• Follow best practices for data security, data quality, and pipeline reliability.

Required Skills

• Strong knowledge of Python.
• Strong knowledge of SQL.
• Understanding of ETL/ELT processes.
• Experience with relational databases such as MySQL, PostgreSQL, or SQL Server.
• Understanding of data warehousing concepts.
• Good understanding of data structures and data processing.
• Knowledge of APIs and data integration.
• Strong problem-solving and analytical skills.

Good to Have

• Experience with AWS, Azure, or Google Cloud.
• Knowledge of Apache Spark / PySpark.
• Experience with Airflow or other workflow orchestration tools.
• Knowledge of data warehouses such as Snowflake, BigQuery, Redshift, or Azure Synapse.
• Experience with Docker and Git.
• Understanding of CI/CD.
• Knowledge of Kafka or other streaming technologies.

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

Who Can Apply

Candidates with experience in:

• Data Engineering
• ETL Development
• Python Development
• SQL Development
• Data Analytics with strong programming skills
• Backend/Data Pipeline Development

What We Offer

• Opportunity to work on real-world data engineering projects.
• Exposure to modern data and cloud technologies.
• Collaborative learning environment.
• Opportunities to develop expertise in data engineering and analytics.

Interested candidates can apply with their updated resume at [email protected]