Data Engineer-Quest Global-Pune

Required Skills

• Strong hands-on experience with Apache Spark
• Proficiency in Scala and/or Python (PySpark)
• Good understanding of Spark internals (RDD, DataFrame, Dataset APIs)
• Experience with data formats like Parquet, Avro, JSON
• Familiarity with distributed systems and big data concepts
• Strong SQL skills
• Experience with cloud platforms (AWS preferred S3, EMR, Glue, Kinesis, Firehose, Hive)
• Knowledge of performance tuning and optimization techniques
• Experience with CI/CD pipelines
• Exposure to streaming frameworks (Spark Streaming)
• Familiarity with workflow orchestration tools like Apache Airflow

Preferred Skills

• Familiarity with Agile development practices.
• Strong analytical and problem-solving skills.
• Good communication and stakeholder collaboration abilities.
• Ability to work independently in a fast-paced environment.
• Ownership mindset with attention to data quality and reliability.

Additional Information

• Team player.
• Effective communication skills.
• Readiness to broaden skills (or enhance existing skills) to GoLang or any other technology related to Java/J2EE.
• Mandatory requirement to work from the Customer Office in Pune location.