Lead Databricks Engineer

About Everforth Apex Systems Mexico

Everforth Apex Systems Mexico is a technology consulting firm that connects highly skilled professionals with challenging, enterprise-scale initiatives. Our teams collaborate with global organizations to build, modernize, and support technology solutions while promoting strong engineering practices, continuous learning, and long-term professional growth.

Position Overview

Apex Systems is seeking a highly skilled Lead Consultant - Databricks Engineer to support the design, development, and optimization of modern data platform solutions within a cloud-native Databricks environment. This individual will play a key role in building scalable data pipelines, implementing data warehouse solutions, integrating REST-based APIs, and driving engineering best practices across the data ecosystem.

The successful consultant will bring deep Databricks expertise, strong data warehousing and API integration experience, and a software engineering-first mindset. They will help advance the organization's Databricks platform strategy, modernize legacy workloads, build scalable production-grade data solutions, and serve as a trusted technical leader within the data engineering practice.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ingestion frameworks using Databricks, Python, SQL, and cloud-native technologies.
• Build and enhance enterprise data warehouse solutions utilizing dimensional modeling methodologies, including fact tables, dimension tables, and Slowly Changing Dimensions (SCDs).
• Develop and integrate data solutions leveraging Python-based REST APIs.
• Implement data engineering solutions that support advanced analytics, reporting, AI, and machine learning initiatives.
• Design and optimize data processing workloads within Azure Databricks environments.
• Develop and maintain PySpark-based ingestion and transformation processes.
• Partner with business and technical stakeholders to translate requirements into scalable data platform solutions.
• Contribute to the modernization of legacy data processing workflows and migration initiatives into Databricks.
• Establish and promote engineering best practices related to code quality, testing, deployment, and operational support.
• Participate in architectural discussions and provide technical leadership around Databricks platform capabilities and roadmap opportunities.
• Mentor team members and contribute to the development of platform standards, reusable patterns, and engineering accelerators.
• Support production operations, monitoring, troubleshooting, and continuous platform improvement initiatives.

Required Experience & Qualifications

• 7+ years of experience in Data Engineering, Data Platform Engineering, or related software engineering disciplines.
• Hands-on experience working within a mature Databricks environment.
• Strong proficiency with:

-Databricks

-Python

-SQL

-REST API integration and development

-Data warehouse design and implementation

-Dimensional data modeling

-Experience designing and implementing:

-Fact and dimension models

-Slowly Changing Dimensions (SCDs)

-Enterprise data warehouse architectures

• Experience building and supporting production-grade data solutions.
• Strong understanding of software development lifecycle (SDLC) practices and engineering fundamentals.
• Hands-on experience with:

-GitHub

-Source control management

-CI/CD pipelines

-Code promotion and release management processes

• Experience developing and supporting cloud-based data pipelines.
• Experience leveraging PySpark for data ingestion, transformation, and data engineering frameworks.
• Ability to operate effectively in a software engineering-oriented environment while delivering data engineering solutions.
• Strong problem-solving skills and passion for continuous learning and emerging technologies.

Preferred Qualifications

• Experience supporting AI and Machine Learning initiatives through data engineering and platform enablement.
• Familiarity with AI-assisted development tools such as Claude Code, GitHub Copilot, or similar solutions.
• Experience with AWS services, including AWS Lambda.
• Exposure to Tableau and Tableau Prep.
• Experience within the Energy, Utilities, or Power Markets industry.
• Databricks certifications are highly preferred.

We offer superior benefits

• 100% PayRoll
• 100% Remote
• 30 days of Christmas Bonus
• SGMM familiar
• Life Insurance
• Visual and Dental Insurance
• 15th Vacation Days + 5 floating days
• Vacation Bonus of 70%
• Free Certifications
• Home Office Bonus quincenal & Grocery vouchers
• Gym Membership
• Performance Bonus of 10%
• PTU (Utilities)