Sr. Developer

Job Summary

Sr Developer with 6 to 10 years of experience will design and optimize data solutions using LakeHouse Spark Job Definition OneLake SQL and PySpark while working in a hybrid day shift model and collaborating with cross functional teams to deliver reliable analytics that support retail banking focused initiatives and strategic decision making across the organization

Responsibilities

• Design advanced data processing solutions on LakeHouse platforms that enable reliable analytics and reporting for critical business initiatives across hybrid environments
• Develop scalable Spark Job Definition pipelines that process large data volumes efficiently while maintaining accuracy and consistency for downstream consumers
• Build and optimize PySpark jobs that transform raw data into curated data sets supporting complex analytical models and operational dashboards for internal stakeholders
• Write high quality SQL queries and stored procedures that ensure robust data extraction transformation and loading while adhering to performance and security standards
• Implement data models within OneLake that unify structured and semi structured data sources to provide a single trusted view for analytics and data products
• Collaborate with data engineers architects and analysts to translate business requirements into technical solutions that align with enterprise data strategies
• Optimize data pipelines for performance reliability and cost efficiency by tuning Spark configurations query logic and resource utilization across environments
• Implement data quality checks validation rules and monitoring processes that prevent data issues and ensure trustworthy insights for decision makers
• Document technical designs data flows and operational procedures clearly so that solutions are easy to maintain enhance and troubleshoot by the wider team
• Support production deployments by analyzing issues performing impact assessments and implementing stable fixes that minimize disruption to business operations
• Participate in code reviews knowledge sharing sessions and continuous improvement activities that uplift engineering standards and foster a culture of technical excellence
• Partner with business teams in domains such as retail banking to understand use cases and ensure data solutions deliver measurable value and positive societal impact
• Adapt effectively to the hybrid work model by collaborating through digital tools coordinating with onsite and remote colleagues and maintaining clear communication

Qualifications

• Demonstrate strong hands on expertise in LakeHouse architectures with a proven track record of delivering scalable and secure data solutions in enterprise settings
• Exhibit advanced skills in Spark Job Definition and PySpark including experience with performance optimization fault tolerance and batch or streaming workloads
• Show proficiency in SQL with the ability to design complex queries optimize execution plans and implement robust data transformations in production environments
• Apply practical experience with OneLake or similar unified data platforms to consolidate disparate sources and support analytics self service and governance requirements
• Bring solid experience in data engineering or development roles with six to ten years of progressive responsibility in modern data platforms and tools
• Utilize knowledge of retail banking or financial services as a nice to have capability to design solutions that align with domain specific data patterns and regulatory needs
• Communicate clearly with technical and non technical partners and contribute to a collaborative culture that supports ethical data use and better outcomes for customers and society

Certifications Required

Preferred certifications include Databricks Data Engineer Associate or Azure Data Engineer Associate or equivalent cloud data engineering credentials