Consultant - Databricks Pyspark Developer

Job Title

Databricks Developer

Job Summary

Role Summary: This job involves design and develop data pipeline using Databricks, Pyspark to deliver CMS compliance initiatives. Job will involve extensive interfacing co-ordination with other senior tech folks (across India US) and complete development activities without any follow-ups required

Responsibilities

• Understand the overall requirement design of the Project engaged
• Work closely with tech leads in India US to understand the existing data pipeline developed in Databricks,Pyspark GCP
• Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
• Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution.

Requirements

• Bachelors degree or higher from a reputed university
• 3 to 6 years total experience with majority of that experience related to ETL experience with Strong Hands on experience in PySpark Databricks
• Good hands on experience in any Cloud Data platform, GCP is preferred.
• Experience in processing streaming data using Kafka / Pub-Sub
• Experience designing and deploying data pipelines orchestration using Apache Airflow.
• Healthcare industry experience

Good to Have

• Extensive experience in GCP associated Data services