Pyspark Data Engineer

JD for Pyspark Data Engineers.

Experience level : 4-7 Years

Location-Bangalore/Pune

• Mandatory development experience in Pyspark
• Expertise in SQL
• Experience in Data Cleaning, Feature Engineering, Transformations
• Expertise in Dataframe, RDD, tuples, lists
• Expertise in optimization using broadcast variables, Dataframe and RDD APIs, methods, partition control etc.
• Good understanding of Spark configurations
• Experience working on Unix based platforms with basic knowledge of shell scripting, writing Cron jobs etc.
• Knowledge of big data ecosystem with knowledge of Hadoop, Hive GitHub version management
• Knowledge of Cloud Computing (GCP), Data Modelling
• Exposure to working on data pertaining to banking and financial services domain
• Highly adaptable in quickly changing technical environments with strong organizational and analytical skills

Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applying.