Senior Python Software Engineer – Azure, Distributed Systems & AI (NYC)

Location: NYC, NY

Work Policy: Hybrid — 2 days per week in-office

Level: Senior

Experience: 8+ years of professional software engineering experience

About the Role

"Please apply only if you can attend in-person interview at NYC location and can do hybrid. This isn't a remote only position"

We are looking for a hands-on Senior Python Software Engineer with deep core Python expertise and a proven track record of building, deploying, debugging, and operating production software on Microsoft Azure.

This role is for an engineer who understands what it takes to ship reliable software beyond the development environment. You have built real applications and backend services, diagnosed complex production issues, improved performance under load, and taken ownership of systems throughout their lifecycle.

We are not looking for data scientists, research-focused AI practitioners, or engineers whose primary experience is building ETL jobs, data ingestion frameworks, or data pipelines. We need a strong software engineer first—someone who writes maintainable Python, understands concurrency and distributed systems, and can independently troubleshoot issues in live environments.

Experience building AI-powered applications and integrating LLMs into production software is a plus, but strong software engineering fundamentals and production ownership are essential.

What You'll Do

Core Python Engineering

• Design, develop, test, and maintain production-grade Python applications and backend services.
• Write clean, modular, maintainable, and efficient Python code using appropriate design patterns and engineering best practices.
• Work with asynchronous programming, concurrency, multithreading or multiprocessing, and efficient resource management where appropriate.
• Diagnose complex application issues, investigate memory and performance bottlenecks, and improve application reliability.
• Build robust error handling, retry mechanisms, timeout management, and recovery strategies for failure-prone systems.

Production Deployment & Operational Ownership

• Own software from development through deployment, production monitoring, troubleshooting, and ongoing maintenance.
• Investigate and resolve production incidents involving application failures, latency, resource exhaustion, dependency failures, and unexpected behavior.
• Use logs, metrics, distributed tracing, profilers, and debugging tools to identify root causes and implement lasting fixes.
• Design and implement effective unit, integration, and regression testing strategies.
• Participate in on-call support, incident reviews, root-cause analysis, and preventive engineering improvements.

Azure Cloud Engineering

• Deploy, operate, and maintain Python applications and services hosted on Microsoft Azure.
• Work with Azure Functions, App Service, Azure Container Apps, Azure Kubernetes Service (AKS), or other relevant Azure hosting services.
• Understand cloud application lifecycle management, scaling, configuration, identity, networking, secrets, and dependency management.
• Troubleshoot production issues involving cold starts, resource limits, service availability, timeouts, throttling, and distributed failures.
• Implement reliable CI/CD workflows, deployment validation, monitoring, and rollback strategies.

Backend & Distributed Systems

• Design reliable APIs and backend services that integrate with databases, external services, and cloud-native components.
• Apply practical knowledge of HTTP, REST APIs, authentication, caching, connection pooling, and service-to-service communication.
• Build resilient applications using queues, asynchronous processing, event-driven communication, and distributed systems patterns where required.
• Understand consistency, idempotency, retries, race conditions, concurrency limits, and failure isolation.
• Collaborate with engineers across application, platform, infrastructure, and AI teams to deliver production-ready solutions.

AI Application Engineering — Preferred

• Integrate LLMs and AI capabilities into production applications using APIs and frameworks such as OpenAI, Azure OpenAI, LangChain, or Semantic Kernel.
• Build application-level AI features, including tool calling, retrieval-augmented generation (RAG), and workflow orchestration.
• Address practical production concerns such as latency, reliability, token usage, cost control, evaluation, and graceful failure.
• Apply conventional software engineering practices to AI applications, including testing, observability, security, and release management.

Required Qualifications

• 8+ years of professional software engineering experience , primarily in backend development, application engineering, or distributed systems.
• Strong hands-on Python expertise , including application design, debugging, testing, performance optimization, and writing production-quality code.
• Demonstrated experience shipping and maintaining software that runs in production—not just prototypes, notebooks, scripts, or proof-of-concept applications.
• Real-world Microsoft Azure experience , including deploying and troubleshooting applications hosted in Azure production environments.
• Strong understanding of backend application architecture, APIs, databases, networking fundamentals, and distributed systems.
• Experience diagnosing production incidents, identifying root causes, implementing fixes, and preventing recurrence.
• Practical experience with automated testing, source control, CI/CD, monitoring, and safe software deployment practices.
• Ability to independently own technical problems, make sound engineering decisions, and communicate clearly during incident investigation and resolution.

Preferred Qualifications

• Experience operating Python applications on Azure Functions, App Service, Azure Container Apps, or AKS.
• Experience with FastAPI, Flask, Django, or similar Python application frameworks.
• Strong understanding of asyncio, asynchronous I/O, concurrency control, and performance profiling.
• Experience with Docker, Kubernetes, infrastructure configuration, and automated deployment workflows.
• Experience with relational or NoSQL databases, caching, messaging systems, and external service integrations.
• Experience shipping AI-enabled applications using LLM APIs, Azure OpenAI, RAG, or agent orchestration frameworks.
• Familiarity with Azure Monitor, Application Insights, Log Analytics, OpenTelemetry, or comparable observability tools.
• Working knowledge of C# or .NET is helpful but not required.

What This Role Is Not

This position is primarily a software engineering role, not a data engineering or research role.

• Not a data scientist or machine learning research position.
• Not primarily an ETL, data ingestion, or data pipeline development role.
• Not a role focused exclusively on notebooks, model experimentation, or AI proofs of concept.
• Not a position where cloud experience is limited to certifications, tutorials, or personal lab projects.

We value engineers who can explain how their software behaves in production, how they investigate failures, and how they make systems more reliable over time.

Interview & Work Logistics

• Location: NYC, NY.
• Work Arrangement: Hybrid, with 2 days per week in the office.
• Interview Process: Candidates must be available for initial in-person interviews at our designated office location in the NYC.

Engineering Depth & Experience Verification

We value demonstrated engineering ability over keyword-heavy résumés.

Candidates should be prepared to discuss real examples of Python applications they have shipped, their role in deploying and operating those applications, and challenging production issues they personally investigated.

We will assess practical Python proficiency, debugging methodology, system design, Azure production experience, testing practices, and operational judgment.

We are looking for engineers who can take ownership, work through ambiguity, and deliver software that remains reliable after it reaches production