Data Engineer - Databricks Migration

Data Engineer - Databricks Migrations

*This is a mid level "do-er" role. Not senior / architect level*

Start: 2 weeks from date of offer

Location: Remote - working PST hours

Length of contract: 6 months

Hourly Pay: 60-64 p/hr on W2

*Background Check Required*

*W2 Contract Only*

Responsibilities:

 Ingests: Design and implement Databricks ingestion processes, leveraging Databricks skills, customer tools and skills with different types of sources.

 Design and Build: Design silver and gold tables in Databricks based on existing solutions deployed in Health Catalyst installed on Microsoft SQL Server.

 Collaborate and Develop: Work collaboratively with Business Intelligence analysts and Business Intelligence developers to design and build silver and gold tables.

 Design and Code Reviews: Prepare for and participate in design and code reviews according to customer design standards.

 Test and Troubleshoot: Participate in testing methodologies, ensuring the functionality and integrity of our reporting solutions. Troubleshoot and resolve errors and solve complex technical problems.

 Compliance: Ensure adherence to corporate policies and privacy regulations like HIPAA.

Experience/skills:

 SQL Proficiency: Strong SQL experience writing queries, creating tables, and performing updates with Transact SQL and DB SQL.

 ETL Expertise: Strong experience writing ETL with Azure Databricks, DBSQL, Microsoft SQL Server, Transact SQL, SSIS.

 Data Ingestion: Experience ingesting data from many different types of sources (RDBMS, XML files, JSON files, Flat files, APIs)

 Database Expertise: Experience with database management systems, including performance optimizing and tuning and security

 Design Experience: Experience with data warehousing methodologies and data model development

 Additional Experience: Experience with Power BI, Health Catalyst, and Epic is a plus

 Communication/Collaboration: Speak up quickly when something is discovered, listen and work with others to solve problems, share lessons learned from prior migrations.

Required criteria:

 Experience: Minimum of 4 years of related experience