Data Engineer (Python, Spark,Cloud) 5 To 8 years experience

Data Engineer Python / Spark / Cloud with 5 to 8 years Experience

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, SQL, PySpark, Apache Spark and Cloud Data Engineering. The role will focus on building scalable data pipelines, ETL/ELT workflows and data platforms to support analytics, reporting and AI/ML initiatives.

Key Skills

• Strong hands-on experience in Data Engineering using Python, PySpark and Apache Spark.
• Design, develop and maintain scalable data pipelines and ETL/ELT workflows.
• Strong SQL skills, including complex queries, optimisation and performance tuning.
• Build data ingestion solutions for structured and unstructured data sources.
• Experience with batch and real-time data processing.
• Build and maintain scalable data lakes, data platforms and distributed datasets.
• Hands-on experience with at least one major cloud platform AWS, Azure or GCP.
• Experience with data warehousing, dimensional modelling and data transformation.
• Implement data validation, cleansing and data quality controls.
• Experience or exposure to Generative AI and Large Language Models (LLMs).
• Familiarity with Git, CI/CD, testing, monitoring and engineering best practices.
• Experience with Airflow, Kafka, Databricks or similar technologies is advantageous.
• Exposure to Delta Lake, Apache Iceberg or Apache Hudi is desirable.
• Knowledge of Docker, Kubernetes, Terraform/IaC and data governance is an advantage.
• Strong analytical, problem-solving, communication and stakeholder collaboration skills.

If interested please mail your resumes to [email protected]