Senior Data Engineer

Description

We are looking for a highly skilled Senior Data Engineer to join our team and take ownership of optimizing, scaling, and maintaining our data infrastructure. You will play a critical role in ensuring data accuracy, performance, and reliability across our systems.

Responsibilities

• Collect, validate, and ensure the accuracy of data from multiple sources
• Optimize and restructure databases to improve efficiency and scalability
• Improve query performance with a strong focus on mission-critical queries (especially for Evidence data)
• Implement and manage DB sharding strategies for scalability
• Design, develop, and maintain data models, warehouses, and ETL pipelines
• Work with frequently updating, high-volume data environments
• Collaborate with product, engineering, and DevOps teams to ensure seamless data flow
• Ensure data security and compliance using IAM roles and permissions

Required qualifications

• Extensive experience working with complex database structures
• Expert knowledge of databases (especially MySQL)
• Strong background in Big Data technologies and large-scale data processing
• Hands-on experience with data modeling, warehousing, and ETL pipelines
• Experience managing frequently updating data systems
• Solid understanding of query optimization and performance tuning
• Proficiency with AWS services, Redis, IAM roles and permissions
• Strong problem-solving skills and ability to work in fast-paced environments

Nice to Have

• Familiarity with Soft DevOps skills (CI/CD, containerization, monitoring, etc.)
• Exposure to modern data stack tools (Airflow, Spark, Kafka, etc.)