Lead - Big Data Engineer

This role is for a data engineer that will operate as a member on one of the core teams responsible for enabling new features and optimizing strategic Analytics platforms across TransUnion. Our multi-Petabyte platforms support a diverse community of internal and customer-based data scientists, statisticians, modelers, product developers and data strategists.

Role Overview And Core Responsibilities:

• Function as a core team member within one of our Agile teams building backend-end data applications and services that support the Analytics platforms of TransUnion

• Deploy and Implement leading-edge analytics environments including software, end-user tools and other data services

• Collaborate with product owners and team members on requirements and implementation approaches for addressing demand and challenges

• Design and Develop tools and services enabling end-user productivity and system integrations

• Partner with business resources to troubleshoot issues, manage capacity, and plan for the optimization and expansion of environments

• Assist in technology innovation activities such as research, evaluations, and prototyping

• Train, coach and support users on environment, tools, data and services

• Maintain and ensure availability and quality of systems

• Required Knowledge And Experiences

• 8 or more years of hands-on experience in a software development profession

• Experience with Cloud technologies, tooling, and workflows

• Proficiency in Cloud Technologies, specifically GCP – BigQuery, Data Proc

• Proficiency in Big Data – Hadoop , Spark , Scala ,Hive

• Experience in Java on basic coding and design

• Experience in Python coding is preferable

• Proficiency in SQL, relational and non-relational databases, query optimization, and data modeling

• Experience with one or more Data Integration tools

• Proficiency working in a Linux-based environment, including shell scripting and basic system administration

• Experience working on teams operating under an Agile Scrum delivery methodology

• Experience working within CI/CD environments and a passion for automation and system quality

• Excellent analytical skills and the ability to provide alternative solutions to technical problems

• Strong written and verbal communication skills

• Bachelor’s degree in Computer Science, Information Systems Management or equivalent experience