Databricks Developer

Key Responsibilities:

• Design, develop, and maintain scalable data processing applications using Python, PySpark and Spark.
• Collaborate with data engineers, data scientists, and other stakeholders to understand business requirements and deliver high-quality solutions.
• Ensure data integrity, performance, and reliability across all data processing pipelines.
• Write clean, maintainable, and efficient code following best practices and coding standards.
• Perform data analysis and implement data validation to ensure quality.
• Monitor and troubleshoot performance issues in data workflows and pipelines.
• Implement and manage CI/CD pipelines for automated testing, integration, and deployment.

Required Skills & Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proven experience as a Databricks Developer, with strong expertise in Spark/Pyspark.
• Proficiency in SQL and hands-on experience with relational databases.
• Strong programming experience in Python and PySpark.
• Familiarity with version control systems such as Git.
• Strong analytical and problem-solving abilities.
• Excellent communication and collaboration skills.