Azure Data Engineer (USD 70-80k/ year)

Upstart AEC is hiring a remote Azure Data Engineer to support the development of a modern Azure-based analytics platform.

This is a hands-on engineering role focused on data ingestion, transformation, modeling, testing, and production support. The ideal candidate is strong in Python, SQL/T-SQL, Azure data services, Spark, and PostgreSQL and is comfortable working across the full data pipeline.

Key Responsibilities

• Build and maintain data ingestion pipelines from SQL Server , including incremental processing, Change Tracking, backfills, reconciliation, and schema-change handling.
• Develop transformation workflows using Python, SQL/T-SQL, PySpark/Spark, Parquet/Delta, and ADLS Gen2 .
• Create configuration-driven ingestion and reusable data-processing patterns.
• Design and maintain PostgreSQL data marts for analytics and reporting use cases.
• Support dimensional modeling, including flexible or custom-field data structures.
• Implement KPI and metric logic for downstream analytics consumers.
• Build automated data-quality and reconciliation tests.
• Contribute through Git-based development workflows, code reviews, documentation, and production runbooks.
• Assist with troubleshooting, deployment readiness, and ongoing platform support.

Required Skills

• Strong Python and SQL/T-SQL skills.
• Experience working with SQL Server data sources and Change Tracking .
• Hands-on experience with ADLS Gen2, Parquet/Delta, and PySpark/Spark .
• Experience building SQL-based transformation pipelines.
• Experience designing PostgreSQL analytics marts .
• Knowledge of dimensional modeling, data quality, backfill, reconciliation, and schema-drift patterns.
• Experience working in production environments using Git and structured deployment processes.

Nice to Have

• SQLMesh
• dlt
• Cube or similar semantic-layer tools
• Dagster or comparable orchestration experience
• Experience with EAV or custom-field data models
• Metabase
• Retail, sales, traffic, or workforce analytics experience