Syedor Rahman

Head of Data Engineering | Azure & Databricks

18 recommendations

Salary / Daily rate

18 people recommend

Dubai - United Arab Emirates

Mobility: London, Dubai - United Ara, ...

Freelance

Remote only

Skills

Data EngineeringDatabricksAzureChange ManagementMachine LearningAWSGoogle Cloud PlatformAISnowflakeKafkaPostgreSQLMongoDBMicrosoft Azure Cosmos DBPythonSQL QueriesPySparkTerraformGitGitHubPower BISplunkGrafanaDevOps

Languages

English (Native)

Recommended by

Mark Sheraton

Huma BI

Data Analyst

Recommended on 08 january 2020

William Sutton

Newton Media Group

Commercial Manager

Recommended on 24 september 2024

Sukesh Dash

Ngenux Solutions

Data & AI Practice Head

Recommended on 17 september 2024

And 15 other people

About me

Intro

Head of Data Engineering with 15+ years building enterprise-scale data platforms across banking, trading, and aviation sectors. Delivered 50% faster time-to-insight through Azure/Databricks Lakehouse architectures, 30% OPEX reductions via governance optimization, and real-time streaming solutions for MT4/MT5 trading platforms. Expert in crafting cost-efficient, compliant data strategies that unlock AI capabilities and measurable ROI for complex multi-region deployments.

Links

Work experience

Head of Data & AI

DATASENSEFreelance

Jun 2024 - Present

2 years 5 months

Dubai - United Arab Emirates

Derive a greenfield data strategy for an aviation operator to process and govern batch/real time data from multiple sources including IOT sensors, booking systems and crucial ground aviation equipment. Resulting architecture was cloud based, deployed via DEVOPS IAC CI/CD pipelines, 4 9’s SLA for Uptime, transparent for regulatory requirements and horizontally scalable for future sites across the GCC. Act as a Data Solution Architect on a large-scale data program. Be hands-on with Microsoft Azure (Data services, security, integration), Databricks (Lakehouse architecture, data processing, optimization, Python, Pyspark). Design and build enterprise data modeling (conceptual, logical, physical models) Lead on technical guidance of data governance, metadata management, and data quality frameworks. Review current data & AI enablement strategy for a financial services operator; provide 2nd opinion on technology and governance choices to address risk mitigation for such a substantial financial investment. Conduct workshops to provide a detailed summary outlining alignment to priorities and future projects, alternative technology choices with pros/cons and a transparent independent evaluation that scoped greater coverage of the available data technology on the market. Outcomes included deduplication of initiatives across departments, 20% cost savings on compute by negotiating with multiple vendors with clearer monthly requirements, 10% reduction on data processing times and potential data monetisation opportunities. Derive comprehensive data management & AI strategies and roadmaps to align with an organisation's overarching business objectives by working closely with business leaders/tech teams to understand needs and develop tailored data & AI solutions. Establish data governance policies and procedures for managing data throughout its lifecycle, ensuring its integrity, protecting data from unauthorized access, loss and proper usage. Evaluate existing data processes, systems, and databases to identify gaps, duplication and inefficiencies, recommend best practices and automated AI driven solutions. Advise on and implement processes for integrating data from various sources to create a unified data architecture for Structured/Semi-Structured and Unstructured data to enable a composable CDP, actionable insights and automated self-learning AI Solutions.

Founder/Host

GCC Tech Talks

Dec 2025 - Present

11 months

Dubai - United Arab Emirates

Founder and co-host of GCC Tech Talks, a podcast rooted in my new home in the UAE, spotlighting the voices of technology and innovation leaders across the Gulf. The platform explores how the region is shaping its digital future, with Dubai’s dynamic ecosystem serving as a launchpad for conversations that resonate across the GCC. Engages with a diverse spectrum of guests, from ambitious startups to established enterprises, delving into strategies, success stories and the bigger picture of transformation journeys. These dialogues capture how the GCC is embracing AI, data, and digital-first models to redefine industries and accelerate regional growth.

Head of Data Engineering

Exinity

Dec 2022 - Jul 2024

1 year 8 months

Dubai - United Arab Emirates

Built enterprise data strategy & governance (policy, lineage, quality, security) for multi-region deployments; reduced time-to-insight by 50% and enabled group wide KPI visibility, performance and automated audit returns for the first time. Designed IAC/DevOps Lakehouse (batch + real-time) on Azure/Databricks targeting 99.99% uptime; cut pipeline MTTR by 60%. Working with high volume real time streaming data pipelines that are fed from MT4 and MT5 trading platforms. Trading activity data exposure spanned FX. Commodities, indices and equities, copy trading, PAMM, Affiliates and IB’s Introduce clearer end to end data lineage by making use of the Atlan data governance tool to achieve insight & KPI validation. Develop the engineering team into building robust data pipelines to support ML models, AI agents and advanced analytics on a new central unified data Lakehouse platform by upskilling 8 engineers that were spread across the world. With this enhanced data infrastructure, reliable data accessibility was enabled to 6 additional departments. End to End lineage visibility was also possible for the first time to non-technical users. Facilitated training and development for team members, fostering a culture of continuous learning. Adopted teams to triage data initiatives with business value realisation and ROI metrics to make prioritisation transparent to stakeholders. Investigate and propose AI tools and models that could drive efficiencies and AI understanding within the business. Lead on ITDATASECOPS initiatives to promote secure movement, resting and processing of PII data.

Head of Data

Vanquis Bank

Jan 2022 - Dec 2022

1 year

London, UK

Led on an initiative to reduce Azure OPEX costs by 30% by introducing end to end linage on Collibra for all data pipelines to surface duplication and possible optimisations; put together tech debt business cases to decouple and split into central data products that departmental data teams consume via databricks delta sharing APIs. Redistribute 40 data professionals into 6 central cross functional sprint teams with a balance of business knowledge across cards, loans, risk and compliance resulting in a 20% uplift in productivity and improved morale. Optimised data processing workflows, resulting in increased efficiency and reduced turnaround times. Established data governance frameworks that improved data quality by 30% on average and compliance across the organisation. Collaborated with stakeholders to align data strategies with business objectives, ensuring data initiatives supported key business initiatives and ROI metrics were tracked and delivered. Provided mentorship and guidance to team members, promoting professional growth and technical development. Work with enterprise architects and act as the data engineering expert for target data tech stack gap analysis and tool selection. Lead on a monitoring solution for data pipelines and automated alerts using Grafana and Splunk.

Lead Data Engineer

BCA Marketplace

Aug 2020 - Jan 2022

1 year 6 months

Silverstone, Towcester NN12, UK

Lead on migration of on-prem SQL DWH to a fully automated Azure cloud CI/CD DEVOPS data pipelines solution resulting in 60% performance improvement on daily updates and enablement of real time analytical use cases. Onboard a team of data professionals for operational support to mitigate risk of dependency on 3rd party consultancy and reduce quarterly costs by 40%. Introduce ways of working across inhouse and consultancy teams to uplift productivity by 20% and have greater visibility of backlog, team performance and future demand. Derive a common data model across 9 EU entities to enable a cross-border valuation training model with a feature store that spanned several languages and other challenging matching criteria for vehicle attribute data. This contributed to an increase of 3-7% in the auction price on average and a better distribution of vehicles across refurbishment centres and capacity utilisation. Improved data processing workflows, leading to greater efficiency and shorter turnaround times. Established and maintained data governance frameworks to enhance data quality and compliance across the organisation. Partnered with various stakeholders to ensure that data strategies aligned with business objectives, supporting critical projects. Work with 3rd Party data suppliers to ingest/transform OEM vehicle specification data ready for data science model training for valuations, buyer recommendation and accuracy models. Championed the introduction of predictive and prescriptive analytics to optimise manufacturing plant machinery uptime, productivity, proactive maintenance as well supply chain car parts demand forecasts.

Data Team Lead

SYEDINA LTDFreelance

Jun 2012 - Aug 2020

8 years 3 months

London, UK

Working as a boutique style consultancy, I provided a vast range of BI/DWH solutions to a broad range of clients through MSPs. Involved in initial C level data initiative roadmap requirement gathering, engage with delivery leads and Business SMEs to derive SOWs for delivery, lead on ETL patterns discovery and strategy, lead on testing approaches, risk and issues resolution and post production support. Project for E-commerce platform Conduct a review/health check on analytical platform, identify data marts required for EMEA region and optimise pipelines which resulted in a 40% performance improvement overnight. Work with EMEA directors to deliver 2 dashboards that highlighted production inefficiency KPI’s that spanned 11,000 product lines. Opportunity identification by using predictive analysis on existing sales data and using market/public data across all EMEA countries resulting in an increase of 20% in sales opportunity pipelines. Budget/Forecast reporting against customer/distributor KPI’s with ability to slice and dice horizontally and vertically by segment/country/product/customer. Project for a SAAS platform Upgrade and migrate to new service provider for embedded objects/dashboards on web SAAS platform to monetise white label BI product for client. Conduct health check and feasibility for a streamed solution migration. Provide a merged solution to make all SAAS client environments like for like – (Modular approach) resulting in 90% reduction in deployment time for customers.

Business Intelligence Developer

Granger Smith Consulting

Sep 2011 - Jul 2012

11 months

Business Intelligence Developer

Idispharma

Oct 2010 - Oct 2011

1 year 1 month

Weybridge, UK

Reporting Analyst

Northampton County Council

Jan 2010 - Oct 2010

10 months

Northampton, UK

Data Analyst

London Borough of Lewisham

Apr 2009 - Jan 2010

10 months

Implementation Support Engineer

South West London & St Georges' MH NHS Trust

Aug 2008 - May 2009

10 months

Senior Data Specialist

London Borough of Hammersmith & Fulham

Oct 2004 - Aug 2008

3 years 11 months


Education

Birkbeck, University of London

Certificate, Economics

2007 - 2008

11 months


Licenses & certifications

Databricks Certified Data Engineer Associate

Issued: –

Certified by Databricks

Azure Databricks Platform Architect

Issued: –

Certified by Databricks

The best place to find your next move

© 2026. All Rights Reserved.