Lead Data Engineer

Lead Data Engineer

We are seeking an experienced Lead Data Engineer to design, develop, and maintain scalable data pipelines and data platforms. This role will focus on data integration, cloud-based data processing, data warehouse development, and performance optimization.

The ideal candidate has strong technical experience in data engineering, cloud technologies, ETL development, SQL, and big data processing. The candidate will also collaborate with business and technical teams to deliver reliable data solutions that support reporting, analytics, and business intelligence.

Key Responsibilities

• Design, develop, and maintain ETL and ELT pipelines to integrate data from multiple sources.
• Build and optimize data processing solutions using Python, SQL, and relevant data engineering tools.
• Develop and maintain data lakes and data warehouses using AWS, Azure, or similar cloud platforms.
• Work with AWS services such as Amazon S3 and AWS Glue to support data integration and processing.
• Implement data models, including dimensional models, to support reporting and analytics.
• Process and transform large datasets using technologies such as Apache Spark, Hadoop, and Hive.
• Integrate data from relational databases, including Microsoft SQL Server and Oracle.
• Monitor data pipelines, troubleshoot issues, and improve data quality, reliability, and performance.
• Collaborate with analytics, business intelligence, and software development teams to understand data requirements.
• Support data access and integration through APIs and other approved data exchange methods.
• Follow data governance, security, documentation, and software development best practices.
• Provide technical guidance to team members and contribute to project planning and delivery.
• Participate in Agile meetings, code reviews, and continuous improvement initiatives.

Required Qualifications

• 8+ years of experience in data engineering, data development, or a related technical field.
• Experience designing and supporting ETL/ELT pipelines and enterprise data solutions.
• Strong programming skills in Python and

Pay: $125,000.00 - $138,000.00 per year

Benefits:

• Flexible schedule

Work Location: Hybrid remote in Houston, TX 77015