Tech Lead

Job Description - Tech Lead

Position Summary:

As a Data Engineering- Tech Lead, you will be working on developing ETL/ELT code using Python, Big Query, GCP. You will work with a dedicated business, offshore development team and follow a Scrum process to develop SQL and Python code to get the data from different source system and transform this data in a centralized Transformed Data Zone in a way that is easily consumable by the business for Brady Corporation and various other brands owned by the company.

Project Description:

As a Member of the Data & Analytics team, youll work on transforming data from multiple sources into useful, consistent and easily consumable data elements. You’ll strive to continuously improve the data lake and data warehouse and achieve our goals of a best-in-class data platform that:

• SQL, Python, BigQuery, GCP experience must
• Develop and unit test data pipelines, database views, functions, and stored procedures to extract data from various sources and transform it within the Transformed Data Zone to meet business need
• Monitor execution of jobs and fix the failures

Responsibilities

• Develop SQL/BigQuery/python code or data flow to integrate and transform data from multiple
• Design and build tables in the Cloud Data Warehouse tailored to business requirements, transforming raw sources into standardized, consistent, and easily accessible data elements.
• Understand warehouse concepts and dimensional data models.
• Work on Unit Testing/Data validation and scheduling of data pipelines, DB views, functions, and stored procedures.
• Provide ongoing enhancement and support for data pipelines in the production environment. Understand critical needs of the business, identify and fix issues with a sense of urgency.
• Work on getting the data from different source systems using Python, API’s etc.
• Work closely with the business analysts and fellow team members to discuss the requirements, come up with the solution, and implement it.
• Work with the end user on better delivery of easy consumable data elements.
• Should be flexible enough to learn new technologies and implement them as required.
• Understand critical needs of the business, identify and fix issues with a sense of urgency.
• Follow the Scrum process and participate in all Scrum ceremonies (daily standups, retrospectives, planning, etc)
• Take ownership of independent stories or modules.
• Should propose the best practices, necessary tools, technology, etc.

Minimum Qualifications

• BE/MCA/B.Sc or M.Sc degree in Computer Science or a related field
• 8-10 years of hands-on experience developing ETL code using Informatica IICS/GCP/BigQuery.
• 8-10 years of hands-on experience developing SQL code, DB views, functions, and stored procedures
• Extensively worked on Python development.
• Exposure to scheduling, monitoring, and rerunning jobs (Airflow & Control-M Preferred).
• Proven expertise in creating mappings, sessions, workflows
• Hands-on experience with relational, dimensional, and unstructured databases
• Exposure working with SQL Server
• Strong communication and problem-solving skills
• Ability to contribute independently.

Desired Skills

• Hands-on experience on Cloud environment.
• Knowledge of scheduling tools.
• Knowledge of SQL Data Warehouse.
• Knowledge of Agile development.

Personal Skills and Qualities:

• A strong and quick learner.
• Self-motivated with strong team spirit.
• Strong work ethic.
• Ability to work independently as well as the ability to work within a team.
• Excellent multi-tasking skills.
• Ability to communicate well with technical and non-technical staff.