Gen AI Data Engineer

Job Summary

Responsibilities: Developes, maintains, and tests infrastructures for data generation. Creates and maintains optimal data pipeline archictecture and assembles data to meet business needs. Assembles large, complex datasets that meet functional / nonfunctional business requirements. Identifies, designs, and implements internal process improvements; automates manual processes; optimizing data delivery and redesigning infrastructure for greater scalability. Builds infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies. Works with stakeholders including the Executive, Product, Data, and Design teams to assist with datarelated technical issues and support data infrastructure needs. Keeps data separated and secure across national boundaries through multiples data centers and AWS regions. Creates data tools for analytics and data scientist team members that that assist with building and optimizing products into innovative, industry leaders. Oversees data generation infrastructure. Builds analytics tools to provide actionable insights and assist data science and analytics team members with building bestinclass products. Work with stakeholders to assist with datarelated tech issues and support data infrastructure needs.

Responsibilities

• Developes, maintains, and tests infrastructures for data generation.
• Creates and maintains optimal data pipeline archictecture and assembles data to meet business needs.
• Assembles large, complex datasets that meet functional / nonfunctional business requirements.
• Identifies, designs, and implements internal process improvements; automates manual processes; optimizing data delivery and redesigning infrastructure for greater scalability.
• Builds infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies.
• Works with stakeholders including the Executive, Product, Data, and Design teams to assist with datarelated technical issues and support data infrastructure needs.
• Keeps data separated and secure across national boundaries through multiples data centers and AWS regions.
• Creates data tools for analytics and data scientist team members that that assist with building and optimizing products into innovative, industry leaders.
• Oversees data generation infrastructure.
• Builds analytics tools to provide actionable insights and assist data science and analytics team members with building bestinclass products.
• Work with stakeholders to assist with datarelated tech issues and support data infrastructure needs.

Intermediate

Intermediate: Applies practical knowledge of sub-function area typically obtained through advanced education and work experience. May require the following proficiencies: Working independently with general supervision. Facing IT function related problems that are difficult but typically not complex. Potentially influencing others within the function through explanation of facts, policies and practices.

Qualifications

University Degree and minimum 3 years of prior relevant experience, or equivalent experience.

Preferred

• SQL
• Python
• Azure data factory
• Spark (experience would be a plus)
• Data transformation
• Cloud Data Experience
• Distributed data warehouse knowledge
• Data Lakes
• Communication and stakeholder management skills

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.