Data Engineer

Data Engineer, Azure Data Factory, Azure SQL Server, DataBricks, Fink jobs, Power BI, DB Performance Tuning

Prior expereince using AI coding tools like Cursor, Claude

Seeking a Staff Data Engineer who has experience integrating data using modern data integration tools and techniques. The ideal candidate should be proficient with creating tables, writing stored procedures, functions and building ETL/ELT jobs to load data from disparate systems. The Staff Data Engineer will be loading data to and from a variety of sources including data marts and transactional applications with conventional ETL/ELT patterns as well as modern data streaming or messaging patterns.

Develop and maintain high-performance code based on SQL Server stack, including Stored Procedures, Views, Functions, and table design for transactional and analytic purposes.

Develop and maintain Extract Transform Load jobs (ETL/ELT) and other data integrations with real-time streaming and API based sources

Develop new data solutions and migrate existing on-premise data solutions to cloud platforms including Azure Databricks and pyspark

Mentor and assist with the technical development of teammates, assist with code and technical reviews

Particiapte in backlog grooming and other agile cerimonies as a technical lead

Create Continuous Integration and Continuous Delivery (CI/CD) pipelines to automate delivery of solutions

Provide support for data solutions, including remediation of failed ETL jobs, integrations and investigation of data quality issues.

Data modeling for transactional and analytical platforms.

Work directly with stakeholders to gather requirements and provide status updates and solution support

Ensure data solutions meet or exceed enterprise regulatory and compliance requirements

Bachelor's degree in business, computer science, computer engineering, electrical engineering, system analysis or a related field of study, or equivalent experience.

4+ years experience using Microsoft SQL Server or equivalent RDBMS

4+ years experience building data integrations leveraging ETL tools such as SSIS or Databricks

Proven knowledge of data integration patterns including ETL/ELT, event messaging and APIs

Familiarity with database change capture tools including Change Tracking and Change Data Capture

Familiarity with data modeling patterns for OLAP and OLTP workloads

Familiarity with Master Data Management concepts and platforms

Familiarity with data product Software Development Lifecycle (SDLC)

Excellent communications skills.

Excellent analytical and technical skills.
The ability to work in a collaborative team environment