Senior Python Engineer (Databricks)

About the Role

We are seeking a Senior Python Platform Engineer to help build scalable solutions that support AI enablement across the organization. This role focuses on developing reusable libraries, frameworks, automation, and platform capabilities that enable Data Scientists and engineering teams to efficiently develop, deploy, and manage machine learning solutions within Databricks.

The ideal candidate combines strong Python software engineering skills with experience building internal developer tools, APIs, integrations, CI/CD pipelines, and automation solutions. Rather than developing machine learning models, this role focuses on building the platforms, tooling, and infrastructure that help teams develop and deploy AI solutions more efficiently and consistently.

Responsibilities

• Design, develop, and maintain platform engineering solutions using Python and Databricks.
• Build reusable libraries and frameworks supporting authentication, authorization, logging, monitoring, reporting, and other common platform capabilities.
• Develop internal tooling and shared services that improve developer productivity and standardize engineering practices.
• Create APIs, integrations, and automation solutions that connect Databricks, Snowflake, enterprise platforms, and cloud services.
• Develop and maintain CI/CD pipelines supporting AI, analytics, and software development workflows.
• Automate environment provisioning, model space creation, configuration management, and deployment processes.
• Support model lifecycle operations through automation, versioning, governance, monitoring, and operational tooling.
• Collaborate closely with Data Scientists, Engineers, Actuaries, and business stakeholders to understand platform needs and deliver scalable solutions.
• Implement DevOps and Infrastructure-as-Code best practices to improve reliability, scalability, and operational efficiency.
• Contribute to platform architecture, technical standards, software quality, testing, and engineering excellence initiatives.

Required Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Engineering, or a related field.
• 5+ years of software engineering, platform engineering, or data engineering experience.
• Strong Python software development experience.
• Experience designing and building reusable libraries, frameworks, SDKs, or internal developer tools.
• Experience developing APIs, integrations, and automation solutions.
• Hands-on experience with Databricks.
• Experience with Snowflake or other enterprise database platforms.
• Experience with CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps, or similar technologies.
• Experience with Infrastructure-as-Code tools such as Terraform or CloudFormation.
• Familiarity with AWS services such as S3, Lambda, EC2, RDS, DynamoDB, EMR, Step Functions, or related cloud technologies.
• Experience working with Git and modern software development practices.
• Strong troubleshooting, analytical, and problem-solving skills.
• Strong communication and collaboration skills.

Preferred Qualifications

• Experience supporting AI, machine learning, MLOps, or ModelOps platforms.
• Experience building platform services that support Data Science and AI teams.
• Experience developing deployment automation and environment provisioning solutions.
• Experience with Scala, Java, or C#.
• Familiarity with Domino Data Lab.
• Knowledge of software observability, monitoring, and logging frameworks.
• Knowledge of insurance, actuarial, risk analytics, or financial services environments.
• Experience translating business requirements into scalable technical solutions.
• Strong systems design and platform architecture experience.