Databricks Data Integration Engineer

• Experience with Delta Live Tables, Unity Catalog, Delta Sharing, and Fivetran connectors.
• Background in working with business-facing stakeholders or cross-functional teams (e.g., finance, operations, sales).
• Knowledge of cloud data platforms (Azure, AWS, or GCP) and hybrid on-prem/cloud architectures.
• Agile and DevOps knowledge to support fast iteration and reliable deployment.
• Excellent written and verbal communication skills, capable of presenting both to technical and non-technical audiences.
• Ability to manage tasks across geographically distributed teams and complex enterprise environments.

Qualifications:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; Master’s preferred.
• 8+ years of experience in data engineering, integration, or analytics roles, with a focus on enterprise applications.
• Strong knowledge of Databricks, Spark, SQL, Python, and Delta Lake.
• Hands-on experience integrating data from Salesforce, Oracle ERP, SAP, or other major enterprise platforms. (optional)
• Solid understanding of ERP/CRM business processes (order-to-cash, procure-to-pay, lead-to-opportunity, etc.) (optional)
• Experience with Azure services (Data Lake, Azure Data Factory, Key Vault, DevOps).
• Ability to gather business requirements and translate them into technical solutions.
• Familiarity with data modeling, data governance practices, and security/access control strategies.
• Strong analytical and problem-solving skills with a collaborative mindset.

Roles and Responsibilities

We are seeking a Data Integration Engineer with deep expertise in Databricks, Azure data services, and enterprise applications (ERP & CRM) such as Oracle ERP, SAP, and Salesforce. This hybrid role is ideal for someone who can bridge the gap between business and technology, driving data integration efforts while aligning closely with functional teams to understand business processes, data requirements, and enterprise system logic.

The successful candidate will lead the development of robust data pipelines, facilitate stakeholder collaboration, and ensure smooth integration across internal systems and third-party platforms.

Key Responsibilities:

• Collaborate with business and IT stakeholders to gather requirements and translate functional needs into scalable data integration solutions.
• Design and implement ETL/ELT pipelines for connecting and transforming data between enterprise systems (Salesforce, Oracle ERP, SAP) and cloud data platforms.
• Serve as a liaison between data engineering teams and functional teams (finance, sales, operations) to align on data mapping, usage, and validation logic.
• Build and optimize Databricks pipelines using Python, SQL, Delta Lake, and Spark for ingestion, transformation, and enrichment.
• Ensure data models reflect business logic and ERP/CRM workflows, maintaining data quality, consistency, and traceability.
• Utilize tools like Fivetran, Azure Data Factory, and custom connectors to manage end-to-end integration processes.
• Manage CI/CD pipelines using Azure DevOps for reliable deployment of data workflows and infrastructure.
• Maintain documentation for functional mappings, data flows, technical specifications, and system interfaces.
• Work with architects and security teams to implement and monitor data security, governance, and access control policies.
• Contribute to ongoing optimization of system performance, ensuring responsiveness and scalability of data solutions.
• Provide guidance and mentorship to junior engineers and support user acceptance testing (UAT) from a functional and technical perspective.
• Participate in cross-functional project planning and act as a subject matter expert for data from ERP/CRM platforms.