Data Engineer

InnoVet Health, a small and growing business that provides health IT professional services to the Department of Veterans Affairs (VA) is looking for an experienced Data Engineer proficient in Databricks, Delta Lake, and medallion/Lakehouse architectures to support healthcare analytics, interoperability, and data integration needs. You will build scalable data pipelines, ensure data quality, and support advanced analytics across clinical, operational, and regulatory datasets. Your work will directly impact VA healthcare delivery by building an analytical infrastructure that enables AI/ML and advanced analytics to deliver short-term and longitudinal insights to healthcare professionals serving Veterans. You will work in an agile environment alongside VA and contractor stakeholders. It is flexible, full-time, and does not require relocation (work-from-home). The pay, benefits, and growth potential are competitive.

Responsibilities

• Gather and translate business, technical, and functional requirements into data architecture and pipeline design decisions. Design and develop Databricks-based ETL pipelines using PySpark, Delta Lake, and medallion/lakehouse architecture.
• Ingest and transform healthcare data from diverse sources.
• Build secure, scalable solutions with attention to latency and reliability requirements.
• Optimize Databricks jobs (performance tuning, cluster sizing, Z-ordering, partitioning).
• Enforce HIPAA-aligned security practices: RBAC, Key Vault, private endpoints, PHI protection.
• Collaborate with data scientists, analysts, and clinical informatics teams.
• Present and discuss results with IT and business stakeholders.
• Participate in company growth and other responsibilities, as assigned.

Qualifications

• Bachelor’s degree in computer science, data analytics, or related field.
• Minimum 4+ years data engineering experience; 2+ years hands-on with Azure and 2+ years hands-on with Databricks.
• Strong skills in Databricks, PySpark, Delta Lake, SQL, and distributed data processing.
• Strong understanding of HIPAA, PHI handling, and secure data architecture.
• Strong understanding of data modeling for analytics (dimensional + lakehouse).
• Excellent problem-solving, collaboration and communication skills.
• Green card or US citizen required because of government contract work.
• No 1099 or corp-to-corp or international outsourcing or staffing agencies.

Preferred

• Experience with Federal EHR (VistA and Oracle Health) data.
• Experience with Azure Event Hubs, Stream Analytics, AWS Kinesis, or similar data streaming platforms is also a plus.

Job Type: Full-time

Pay: From $125,000.00 per year

Benefits:

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Paid time off
• Referral program
• Vision insurance

Application Question(s):

• This position works directly with US government contracts and under Order 11935, it requires either U.S. Citizenship or valid Green Card. Please answer 2 if you are a US citizen, 1 if you have a valid green card, 0 if neither. Please make sure to answer this question.
• Your LinkedIn profile link (required):

Education:

• Bachelor's (Required)

Experience:

• Azure Data Lake: 2 years (Required)
• Databricks: 2 years (Required)

Location:

• United States (Required)

Work Location: Remote