Senior Python Lead / Architect / Manager

Role Overview

We are seeking a Senior Python Lead / Architect to own the architecture, design, and evolution of our core Python framework that powers Datagaps' data quality, ETL testing, and BI validation products. This is a hands-on technical leadership role. You will define architectural direction, set engineering standards, drive design and code reviews, and lead a team of Python engineers to deliver scalable, high-performance, enterprise-grade solutions.

Key Responsibilities

• Own the architecture and roadmap of the core Python framework and backend services, ensuring scalability, performance, extensibility, and security.
• Translate product requirements into technical designs, and define standards for microservices, APIs, data pipelines, and BI integrations.
• Lead design and code reviews, AI driven development, enforce coding standards, and drive best practices in testing, CI/CD, and release management.
• Evaluate and select technologies and proactively address technical debt and performance bottlenecks.
• Stay hands-on for critical components, proofs of concept, and complex problem-solving including integrating LLM/GenAI capabilities into the product.
• Lead and mentor a team of Python developers, managing sprint planning, task allocation, performance feedback, and hiring.
• Collaborate with Product, QA, DevOps, and UI teams, and communicate architectural decisions and trade-offs to stakeholders.
• Collaborate in integrating LLM/GenAI capabilities into applications.

Required Skillsets

• 8+ years of software development experience, with at least 8 years in Python and 2+ years in a technical lead, architect, or engineering manager role.
• Expert-level Python skills, with deep experience in frameworks such as FastAPI, Flask, or Django.
• Proven experience designing and maintaining reusable frameworks, SDKs, or platform components used across multiple products or teams.
• Strong command of object-oriented design, design patterns, SOLID principles, and clean architecture.
• Deep understanding of concurrency in Python: multithreading, multiprocessing, and asyncio.
• Extensive experience with RESTful API design, microservices architecture, and distributed systems.
• Strong SQL skills and hands-on experience with relational databases (PostgreSQL, MySQL, SQL Server, Oracle) and NoSQL stores, including data modeling and query optimization.
• Solid knowledge of ETL processes, data pipelines, and data integration techniques.
• Strong experience with Git, branching strategies, CI/CD pipelines, and automated testing frameworks (pytest, unittest).
• Demonstrated ability to perform rigorous code reviews and drive engineering quality at team level.
• Experience leading teams in Agile/Scrum environments.
• Excellent communication, stakeholder management, and leadership skills.

Preferred Skills (Nice-to-Have)

• Experience with Apache Spark / PySpark for large-scale data processing.
• Exposure to AI-driven development, including AI coding assistants (e.g., GitHub Copilot, Claude Code, Cursor) for design, coding, review, and testing, and integrating LLM/GenAI capabilities into applications.
• Experience with BI/Analytics tools such as Power BI, Tableau, or Qlik, and integrating backend services with BI platforms.
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) and cloud-native architecture.
• Expertise in Docker, Kubernetes, and container orchestration for deployment at scale.
• Working knowledge of Pandas, NumPy, and related data libraries.
• Experience with performance profiling, caching strategies, and system observability (logging, metrics, tracing).
• Prior experience in a product company, particularly in data quality, data testing, or data engineering tools.
• Exposure to Java/Spring Boot or Angular-based ecosystems is a plus.