Associate III - Data Engineering

Role Description 3 to 5 years of Software engineering experience, ideally in infrastructure or data platform roles.

• Proficiency in Python/PySpark and strong knowledge of SQL.
• Experience with Terraform or similar Infrastructure-as-Code (IaC) tools.
• Strong knowledge of at least one cloud platform (GCP/AWS)
• Solid CI/CD experience
• Data & MLOps Expertise:
• Strong Background in Databricks, specifically Unity Catalog, medallion architecture, and Databricks Asset Bundles (DABs).
• Proficiency in Python and API frameworks such as FastAPI or Flask.
• Strong experience designing, developing, and maintaining RESTful APIs.
• Good understanding of data engineering concepts such as data modeling and workflow orchestration.
• Experience with MLOps and Data Engineering like having worked on Spark/Delta Lake/MLflow/ETL frameworks (e.g., Fivetran, Lakeflow Connect).
• Operational Excellence:
• Experience with Github workflows, including container versioning.
• Proficiency with incident management and observability tools (e.g., PagerDuty, system monitoring).
• Mindset & Collaboration:
• An AI as a partner mindset.
• A collaborative approach, including asking questions, navigating unclear requirements, and actively contributing to knowledge sharing/community enablement.

Skills Databricks, FastAPI, Terraform, Python, ETL, Infrastructure as Code, MLOps, Data Modeling, Workflow Automation, PySpark, Flask