Software Engineer, Metadata Collection

ROLE PURPOSE

Design and build the metadata collection that feeds Tinker, drawing metadata from Snowflake and, where relevant, from the Teradata data warehouse so that it is complete, current and trustworthy.

RESPONSIBILITIES

• Design and implement automated collection of technical metadata for Tinker.
• Use Snowflake system databases and metadata views to extract structure, object, usage and access information.
• Apply Snowflake database design principles so the collected metadata reflects how data is actually modelled and organised.
• Evaluate and, where it adds value, use Snowflake Cortex capabilities in the metadata workflow.
• Map Teradata data warehouse structures and conventions to their Snowflake equivalents where required.
• Build reliable, monitored and well-documented pipelines, and handle failures and schema changes gracefully.
• Work with the lineage and data quality tracks so that collected metadata can be reused by both.

REQUIRED EXPERIENCE

• Strong hands-on Snowflake experience.
• Solid knowledge of Snowflake system databases and metadata collection.
• Knowledge of Snowflake Cortex.
• Understanding of Teradata and data warehouse principles.
• Senior-level software engineering background, including SQL and at least one scripting or programming language.

NICE TO HAVE

• Hands-on Teradata experience.

Experience with metadata catalogues or governance tooling.