Databricks Technical Lead (Data Engineering)

About the Role

Eclipse Consulting Group partners with highly regulated, data-intensive organizations to solve complex business, risk, and technology challenges. We help organizations modernize enterprise data capabilities, strengthen governance, and deliver strategic transformation across financial services and other regulated industries.

Eclipse Consulting Group is currently seeking a Databricks Technical Lead to support a large-scale Databricks enterprise data platform initiative launching later this year. The Technical Lead will anchor the initial team, shape the platform, lead technical delivery, and provide direction as the team expands.

Responsibilities

• Lead the Databricks platform build from mobilization through production releases across U.S. and offshore teams.
• Shape the lakehouse architecture, including ingestion patterns, medallion (bronze, silver, gold) layers, Delta Lake, and Unity Catalog governance.
• Translate business and data requirements into technical designs and executable work for engineering teams.
• Lead technical discussions with client architecture, security, and data teams, manage dependencies, scope, and change, and make the call on design tradeoffs.
• Establish engineering standards and review pipelines, code, and data models before production.
• Plan environment setup, CI/CD, and release practices in partnership with the project manager.
• Identify delivery risks early, including performance, cost, and data quality, and communicate progress, risks, and key decisions to client stakeholders and program leadership.
• Provide day-to-day technical direction and coaching to the distributed engineering team.

Qualifications

• 8+ years of experience in data engineering or data architecture, including 4+ years of hands-on Databricks experience.
• Experience leading a team or workstream through a production Databricks or Spark platform implementation—not solely proofs of concept.
• Strong PySpark and SQL skills, with working knowledge of Delta Lake, Unity Catalog, and Databricks Workflows.
• Experience with AWS or Azure.
• Experience leading distributed teams, including offshore engineers.
• Ability to communicate technical decisions and design tradeoffs to senior stakeholders.
• Authorization to work in the U.S. without current or future sponsorship.

Preferred Skills

• Databricks certification, such as Data Engineer Professional or similar.
• Asset management or investment data experience, including holdings, positions, transactions, or security reference data.
• Consulting experience.

Please note: This opportunity is available exclusively on a C2C/1099 basis.

The Eclipse Way

Why Eclipse Consulting Group?At Eclipse, you'll join a collaborative consulting team delivering enterprise-scale transformation for leading financial institutions. You'll work directly with senior business and technology leaders on complex data and technology initiatives with meaningful business impact.

Our culture is built on six core values:

• Passion : We bring energy, ownership, and commitment to every engagement.
• Continuous Improvement : We keep improving ourselves, our clients, and the solutions we deliver.
• Meritocracy : We recognize and reward performance, initiative, and meaningful contribution.
• Teamwork : The best outcomes come from collaboration, trust, and shared success.
• Customer Commitment : We build lasting client relationships through quality, integrity, and execution.
• Ingenuity : We solve complex business challenges with thoughtful, practical, and innovative solutions.

If you're passionate about building modern data platforms on Databricks and leading complex enterprise delivery, we'd love to hear from you.