DATA and Azure Cloud Engineer

Software Engineer Senior Lead - W2 only

Top skills

• Azure cloud
• azure data factory
• data bricks
• data pipeline
• snowflake
• Python and Fast API
• AI
• Frond end ex – Nice to have
• AWS – Nice to have
• Java – Nice to have

Job Description

About the Role

We are seeking an experienced Software Engineer Senior Lead to drive the design, development, and delivery of enterprise-grade, cloud-native solutions within a modern Azure ecosystem. This is a hands-on technical leadership role focused primarily on backend engineering; scalable microservices, enterprise APIs, distributed systems, and data engineering with secondary contributions to modern front-end applications (React, Vue.js, Next.js, Tailwind CSS).

In this role, you will establish engineering standards, mentor development teams, and influence architectural decisions across application development, cloud infrastructure, data platforms, and modernization initiatives. Success will be measured by platform reliability, scalability, security, cost efficiency, engineering velocity, and business impact in highly regulated environments.

What you will be doing

Application Development & Architecture

Design and build cloud-native applications and scalable microservices using Java, Spring Boot, Python, and FastAPI.

Develop secure REST APIs and event-driven services for internal and external consumers.

Lead technical design and architectural guidance for large-scale enterprise platforms.

Create reusable frameworks, libraries, and engineering standards.

Design multi-region, highly available architectures with disaster recovery and business continuity.

Translate business requirements into technical solutions with product, security, and architecture teams.

Cloud & Platform Engineering

Build and operate solutions using Azure-native services: AKS, Container Apps, Function Apps, Application Gateway, API Management, Key Vault, Storage, Monitor, Azure SQL, Cosmos, Application Insights, and Log Analytics.

Design secure network architectures (VNets, Subnets, Private DNS, Private Endpoints).

Implement Infrastructure as Code with Terraform and Terraform Enterprise (TFE).

Establish cloud governance, security baselines, and operational best practices.

Lead cloud modernization and application migration efforts.

API & Integration Engineering

Design, secure, monitor, and manage enterprise APIs through Azure API Management.

Implement API lifecycle management: versioning, throttling, quotas, rate limiting, caching, and policy enforcement.

Define enterprise API standards and governance frameworks.

Microservices, Observability & Reliability

Apply patterns including service discovery, circuit breakers, distributed caching, event-driven architecture, and fault tolerance.

Implement observability: centralized logging, distributed tracing, APM, metrics, alerting, and health dashboards.

Define SLOs and SLIs; optimize performance, scalability, and latency.

Data Engineering & Analytics

Build scalable, metadata-driven data pipelines using Azure Data Factory and Databricks.

Develop ingestion and transformation pipelines across ADLS, Databricks, Cosmos DB, and enterprise/third-party systems.

Optimize Databricks jobs and clusters for performance and cost.

Implement data replication, backup, and retention strategies.

Security & Identity

Design authentication and authorization using OAuth 2.0, OIDC, Microsoft Entra ID, and JWT frameworks.

Implement RBAC, secrets and certificate management, and secure API authentication.

Ensure compliance with security, audit, and regulatory requirements.

DevOps & Engineering Excellence

Build and maintain CI/CD pipelines with GitHub Actions.

Manage source control, branching, release management, and deployment automation.

Implement automated testing, security scanning, and quality gates.

Mentor teams and promote best practices in software engineering excellence and DevOps.

Required Qualifications

Bachelor's degree in Computer Science, Software Engineering, or related field.

10+ years of enterprise software engineering experience.

Expert-level Java and Spring Boot, Python and FastAPI.

Proven experience building microservices, REST APIs, and integration services.

Hands-on expertise with Azure cloud-native services and architecture patterns.

Experience with Terraform/TFE, AKS, Container Apps, and containerized workloads.

Strong knowledge of Azure API Management and API governance.

Experience with observability, distributed tracing, and monitoring.

Proficiency with GitHub, GitHub Actions, and CI/CD.

Experience with OAuth2, OIDC, Microsoft Entra ID, and identity providers.

Experience with cloud-native storage (Cosmos DB, Postgres, Azure SQL).

Strong networking knowledge (VNets, Subnets, Private Endpoints, DNS, firewalls).

Experience with disaster recovery, geo-redundancy, and high availability.

Strong analytical, communication, and leadership skills; Agile/Scrum experience.

Preferred Qualifications

Master's degree in Computer Science, Software Engineering, or related field.

Experience in Financial Services, Banking, Payments, FinTech, or other regulated industries.

Front-end experience with React, Vue.js, TypeScript, and JavaScript.

Experience with Azure Data Factory, ADLS, and Databricks.

Knowledge of DDD, Event-Driven Architecture, CQRS, and SRE practices.