Technical Lead - Data Engineering

Company Description Trident Recruitment Solutions is a specialized talent partner that supports organizations with recruitment and managed outsourcing services. The company helps clients scale quickly by providing highly skilled professionals across software, data, and enterprise platforms. Trident focuses on building long-term relationships with both clients and candidates, ensuring strong alignment between business needs and individual career goals. As a growing service provider, it offers opportunities to work with diverse technologies and industries while contributing to impactful staffing solutions.

Key Responsibilities

Lead requirements gathering and translate business needs into technical specifications, epics, and user stories. Oversee the design, development, and optimization of scalable data engineering solutions across GCP and AWS, leveraging AI agents and automation to improve testing, monitoring, and debugging. Manage end-to-end data engineering delivery, cloud infrastructure, security, CI/CD pipelines, system performance, reliability, and cost optimization. Lead production incident management and root cause analysis while ensuring operational stability. Collaborate with Product Owners, Business Analysts, and DevOps teams to align technical solutions with business objectives. Mentor and manage Data Engineers, conduct technical reviews and performance evaluations, and oversee resource planning and career development. Maintain technical documentation, data catalogs, and deployment guidelines while collaborating with global stakeholders across international time zones as required.

Requirements & Core Competencies

• Bachelor’s degree in CS or equivalent, plus 6+ years of experience in data engineering,

including 2+ years leading engineering teams.

• Mastery of Python, SQL, Shell scripting, Medallion architecture, advanced dimensional

modeling, real-time data streaming, GCP/AWS cloud stacks, CI/CD/DevOps practices.

• Experience in working with FinOps fundamentals for effective cost management.

• Capability to drive team-wide adoption of AI-assisted operational and engineering tools.

• Experience in leading engineering teams in data modeling, ETL design and development,

streaming data in cloud data environments, using various ETL tools and technologies.

• Leading engineers in working in a Scrum/Agile delivery environment.

• Experience in API development would be an added advantage.

• Demonstrates strong self-management on assigned tasks; collaborates effectively with

QA, DevOps, and Business Analysts.

• Experience in cloud infrastructure security, including keeping EC2 instances and other

cloud components up to date, applying security patches, addressing vulnerabilities, and

maintaining compliance with organizational security standards.

• Strong communication and interpersonal skills, with the ability to influence and

effectively communicate technical concepts and decisions.

• Hands-on experience in working closely with non-technical people and sound knowledge

of the technical and business domains