Senior Data Engineer

Role-: Senior Data Engineer – Databricks

Location: LATAM (Latin America)

Work Model: Remote

Employment Type: Contract-to-Hire (C2H)

Job Overview

They are seeking an experienced Senior Data Engineer with strong hands-on expertise in Databricks to design, build, and optimize scalable data engineering solutions. The ideal candidate will have experience developing robust data pipelines, implementing modern lakehouse architectures, and transforming complex datasets into reliable, analytics-ready data.

The candidate will work closely with data architects, analytics professionals, and business stakeholders to deliver high-quality data solutions that support enterprise reporting and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and PySpark.
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and integration.
• Develop data lakehouse solutions using Delta Lake and Delta Tables.
• Write complex SQL queries and optimize data processing performance.
• Work with cloud platforms such as Azure, AWS, or GCP.
• Implement data quality checks, validation processes, and monitoring mechanisms.
• Optimize Spark jobs, cluster configurations, and pipeline performance.
• Collaborate with analytics and BI teams to deliver trusted, analytics-ready datasets.
• Follow best practices for data security, governance, version control, and CI/CD.
• Troubleshoot data pipeline issues and maintain technical documentation.

Required Qualifications

• 5+ years of experience in data engineering.
• Strong hands-on experience with Databricks, Apache Spark, and PySpark.
• Proficiency in Python and SQL.
• Experience building production-grade ETL/ELT pipelines.
• Strong knowledge of Delta Lake and lakehouse architecture.
• Experience with at least one major cloud platform: Azure, AWS, or GCP.
• Understanding of data modeling, data warehousing, and distributed data processing.
• Strong analytical, communication, and problem-solving skills.

Preferred Skills

• Databricks Workflows, Unity Catalog, and Delta Live Tables/Lakeflow.
• Apache Airflow or other orchestration tools.
• Streaming data processing and Kafka.
• Experience supporting enterprise analytics and BI platforms.

Engagement Details

• LATAM-based candidate required.
• Contract-to-Hire engagement.
• Availability and working-hour overlap with US teams to be confirmed.
• Compensation, contract duration, and conversion terms to be discussed.