Data Engineer

Data Engineer

Onsite in Eastwood

Earn up to 100k monthly + other benefits

Qualifications

Education and Experience

• Bachelor’s degree in Computer Engineering, Data Science, Statistics, Physics, Information Technology, or a related field.
• At least 5 years of professional experience in Data Engineering , with hands-on experience in Databricks and AWS.
• Experience working with cloud computing platforms, particularly AWS and Microsoft Azure.
• Familiarity with Agile methodologies, including Scrum and Kanban.

Technical Skills and Competencies

Programming and Query Languages

• Python, including Apache Spark / PySpark
• SQL
• DAX

Data Formats

• Parquet
• SQL
• CSV
• Excel (XLSX)
• JSON
• TXT

Tools, Systems, and Platforms

• GitHub
• Databricks
• Amazon Web Services (AWS)
• Microsoft Power BI
• Linux

Data Engineering Expertise

• ETL/ELT development and data integration
• API integration and data connectivity
• Data pipeline development, orchestration, and maintenance
• Data modeling and data wrangling
• Data quality management and validation
• Data governance and data management practices
• Statistical analysis and application of statistical concepts
• Code optimization and performance tuning

Nice-to-Have Qualifications

Experience or familiarity with any of the following technologies and platforms is an advantage but not required:

• LS Central
• Microsoft Dynamics 365 Business Central
• Microsoft SQL Server
• Microsoft Azure
• Tableau
• JavaScript
• HTML and CSS
• AL (Application Language for Microsoft Dynamics 365 Business Central)