DataOps/Cloud Data Engineer - Senior

DataOps/Cloud Data Engineer - Senior

Onsite - Toronto ON

Mandatory Skills and Experience (8+ years experience):

• Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
• Development of unified data platforms using Databricks and Unity catalog or its equivalent.
• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
• Advanced SQL skills (PL/SQL, TSQL).
• Big Data processing Frameworks (PySpark).
• Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
• Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.

Desirable Skills and Experience:

• Data lake design and development with focus on extracting, transforming data coming from various data sources and loading into Lakehouse in medallion architecture.
• Advanced skills and hands-on experience with Oracle databases, Azure SQL Server and Azure Data Factory.
• Cloud technologies (Azure, Google, AWS).
• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
• Scripting languages (Python, Unix shell, Scala).