Azure Databricks using Python

Azure Databricks using Python/ PySpark/ SparkSQL.

Exp Range 6+ yrs.

Job Description -

• Bachelors degree / Master's Degree with high rankings from reputed colleges
• 3+ years ETL /Data Analysis experience with a reputed firm
• Expertise in Big Data Managed Platform Environment like Databricks using Python/

PySpark/ SparkSQL

• Experience in handling large data volumes and orchestrating automated ETL/ data pipelines

using CI/CD and Cloud Technologies.

• Experience of deploying ETL / data pipelines and workflows in cloud technologies and

architecture such as Azure and Amazon Web Services will be valued

• Experience in Data modelling (e.g., database structure, entity relationships, UID etc.) , data

profiling, data quality validation.

• Experience adopting software development best practices (e.g., modularization, testing,

refactoring, etc.)

• Conduct data assessment, perform data quality checks and transform data using SQL and ETL tools
• Excellent written and verbal communication skills in English
• Self-motivated with strong sense of problem-solving, ownership and action-oriented mindset
• Able to cope with pressure and demonstrate a reasonable level of flexibility/adaptability
• Track record of strong problem-solving, requirement gathering, and leading by example
• Able to work well within teams across continents/time zones with a collaborative mindset