Data Engineer

Roles and Responsibilities

• Database/Data Warehouse Development: Strong understanding of SQL and designing efficient queries, including a conceptual understanding of tabular data modeling and its development.
  • Data Pipeline Development: Assist in building and maintaining data pipelines for ETL (Extract, Transform, Load) processes using various tools and techniques in Azure (Data Factory, Databricks (incl. Data Lakehouse), DevOps, and Storage Accounts) & Snowflake environments.
  • Data Lake Development: Assist in developing the medallion framework for persisting,
    transforming and creating data models. Depending on the data extraction frequency, design appropriate approaches for data ingestion i.e., full versus incremental data loads
  • Data Visualization: Build powerful dashboards and reports in Power BI, Tableau, or any other BI tool

Preferred candidate profile

• Experience: Minimum 3 years of experience is mandatory in data management projects involving technologies like Microsoft Fabric, Snowflake, and Databricks, along with related tools.
  • Programming Skills: Excellent skills in SQL & Python are essential for this role
  • Data Management: Basic understanding of database management systems, data warehouses, and data modelling is essential for this role
  • Analytical Skills: Strong analytical abilities to interpret trends and patterns in complex datasets.
  • Communication Skills: Excellent verbal and written communication skills for collaborating with team members.