Catalyte

Mid-Level Data Engineer (Max hourly rate = $64.00)
No C2C's
We are seeking a Mid-Level Data Engineer to join our team and support data modernization and migration initiatives. This role will work closely with technical data scientists and other engineering stakeholders to develop, maintain, and improve data pipelines and workflows using Python, PySpark, Azure, and Azure Databricks.
The ideal candidate has a solid software development foundation, an interest in data engineering, and the ability to work independently in a technical environment. Experience with data engineering is valuable, but strong software development skills and the ability to learn new technologies are equally important.
RESPONSIBILITIES
<ul>
<li>Develop and maintain data processing and transformation workflows using Python and PySpark
</li>
<li>Build, test, and maintain data pipelines and related engineering processes
</li>
<li>Support the migration of data from legacy sources to modern data platforms
</li>
<li>Work within Azure and Azure Databricks environments
</li>
<li>Develop and maintain automation and CI/CD workflows using GitHub Actions, Bash, and Python
</li>
<li>Troubleshoot data and application issues and identify opportunities to improve reliability and efficiency
</li>
<li>Collaborate with data scientists and other technical stakeholders to understand requirements and translate them into effective engineering solutions
</li>
<li>Participate in code reviews, testing, documentation, and other software development practices
</li>
<li>Take ownership of assigned work, identify issues proactively, and contribute to solutions with limited day-to-day direction
</li>
<li>Learn and apply data engineering concepts, tools, and practices as needed
</li>
</ul>
REQUIRED QUALIFICATIONS
<ul>
<li>Experience with Python in a professional software development environment
</li>
<li>Experience with PySpark or Spark
</li>
<li>Experience with Git and modern software development practices
</li>
<li>Experience with scripting and automation using Python and/or Bash
</li>
<li>Ability to work independently, take initiative, and manage assigned work
</li>
<li>Strong problem-solving and analytical skills
</li>
<li>Ability to communicate technical concepts clearly to both highly technical and less technical stakeholders
</li>
<li>Willingness and ability to learn new technologies and data engineering practices
</li>
</ul>
PREFERRED QUALIFICATIONS
<ul>
<li>Experience with Azure
</li>
<li>Experience with Azure Databricks
</li>
<li>Experience with GitHub Actions or similar CI/CD platforms
</li>
<li>Experience developing or supporting data pipelines
</li>
<li>Familiarity with data engineering concepts, data migration, ETL/ELT, and data transformation
</li>
<li>Experience working with data scientists, analytics teams, or other technical stakeholders
</li>
</ul>
WHAT YOU'LL WORK ON
The team is currently focused on migrating data and workflows from legacy sources to newer data platforms and technologies. Specific data sources, workflows, and team processes will be covered during onboarding.
This is an opportunity for a software engineer or data engineer who enjoys learning new technologies and solving problems to develop deeper expertise in modern data engineering, cloud platforms, and Databricks.

Mid-Level Data Engineer (Max hourly rate = $64.00) No C2C's

Mid-Level Data Engineer (Max hourly rate = $64.00) No C2C's

This job is no longer available

Talents

Recruiters

About