Data Engineer

Data Engineer
Indore | Full-time | 5+ years

ThoughtWin IT Solutions is hiring a Data Engineer to design, build and maintain scalable data pipelines and platforms across cloud and big data ecosystems. The role works directly with international clients, so excellent communication skills are essential.

What you’ll do

• Design, develop and maintain scalable ETL/ELT pipelines
• Build and optimize pipelines with Hadoop, Apache Spark, PySpark and Spark SQL
• Build and maintain data warehouses on Snowflake
• Implement data models (star schema, snowflake schema, SCD)
• Orchestrate workflows with Airflow and related tools
• Deploy data solutions on AWS, Azure or GCP
• Set up data quality checks, validation, monitoring and error handling
• Collaborate with analysts, data scientists and business stakeholders
• Troubleshoot complex pipeline issues and optimize for performance, reliability and cost

What we’re looking for

• 5+ years of hands-on data engineering experience, including production-grade pipelines
• Hadoop (HDFS, YARN, Hive), Apache Spark/PySpark, Kafka (working knowledge)
• Snowflake and advanced SQL
• Python and basic shell scripting
• Experience on at least one cloud platform (AWS, Azure or GCP)
• Orchestration with Airflow, Azure Data Factory or similar
• Git and CI/CD (GitHub Actions, Jenkins or Azure DevOps)
• Experience with Parquet, Avro, ORC, JSON and CSV formats
• Excellent communication skills for working with international clients
• Databricks, Delta Lake, Iceberg, Docker or Kubernetes is a plus

Location requirement: Candidates currently based in Indore or nearby (Ujjain, Bhopal, Sagar) only. Relocation applications can’t be considered.

Pay: Up to ₹1,500,000.00 per year

Work Location: In person