Lead/ Senior Data Engineer_ Exp: 9+ Years (Python+ PySpark+ Databricks

Role & responsibilities

• Design, develop, and optimize database-centric solutions on a high-volume data platform.
• Comfortable with at least one language with Python.
• Work extensively with SQL in a large-scale production environment
• Develop and improve ETL/data pipelines supporting critical risk data.
• Contribute to our planned Azure cloud migration, especially on Databricks as it ramps up
• Support evaluation and adoption of new technologies and approaches
• Bring ideas and energy to improve how the platform is built and operated
• Solid SQL skills, including performance optimization
• Experience working with ETL pipelines or data processing systems
• Exposure to or strong interest in Azure (e.g. Azure SQL, Data Factory, migration projects)