Data Engineer/ Senior Data Engineer

Position: Data Engineer / Senior Data Engineer

Desired Experience: 2 - 10 years

You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a problem-solution attitude.

What is in it for you:

• Opportunity to work with a world class team of business consultants and engineers solving some of the most complex business problems by applying data and analytics techniques
• Fast track career growth in a highly entrepreneurial work environment
• Best-in-industry renumeration package

Essential Technical Skills:

• Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools: Tableau and PowerBI
• Experience with cloud, container and micro service infrastructures
• Experience working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams
• Hands-on experience with data modelling, query techniques and complexity analysis

Desirable Skills:

• Experience/Knowledge of working in an agile environment and experience with agile methodologies such as Scrum
• Experience of working with development teams and product owners to understand their requirement
• Certifications on any of the above areas will be preferred.

Your duties will include:

• Develop data solutions within a Big Data Azure and/or other cloud environments
• Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams
• Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse
• Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps showing key items such as upgrades, technical refreshes and new versions
• Perform data mapping activities to describe source data, target data and the high-level or detailed transformations that need to occur;
• Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau
• Data Integration, Transformation, Modelling
• Maintaining all relevant documentation and knowledge bases
• Research and suggest new database products, services and protocols

Essential Personal Traits:

• You should be able to work independently and communicate effectively with remote teams.
• Timely communication/escalation of issues/dependencies to higher management.
• Curiosity to learn and apply emerging technologies to solve business problems