Ajay Baddam
Azure Data Engineer
Salary / Daily rate
London, UK
Freelance, open to permanent contract
Skills
About me
Intro
Results-driven Azure Data Engineer with 4 years of hands-on experience in architecting and optimizing scalable cloud-based ETL/ELT pipelines. Expert in leveraging Python, PySpark, and Azure Databricks to automate big data workflows, resulting in runtime reductions of up to 35%. Proven track record in building metadata-driven frameworks using Delta Lake, Microsoft Fabric, and Azure Synapse while ensuring robust data governance via Unity Catalog.
Work experience
Data Engineer
Recruit First
May 2024 - Feb 2026
1 year 10 months
– Pipeline Architecture: Engineered automated ETL pipelines using Microsoft Fabric, Databricks, and PySpark to process 500M+ records daily. – Performance Tuning: Redesigned big data workflows in Databricks, reducing processing time by 35% and optimizing cluster utilization. – Automation: Developed Python-based data modeling and integration test cases, reducing manual intervention and error rates by 40%. – DevOps & Governance: Established CI/CD pipelines via Azure DevOps; implemented IAM/RBAC policies to secure sensitive data assets.
Data Engineer
Scion
Aug 2021 - Oct 2022
1 year 3 months
– Infrastructure: Architected layered Data Lake solutions using Delta Lake principles, significantly reducing query latency for analytical workloads. – Cost Efficiency: Optimized PySpark ETL pipelines and Databricks job clusters, reducing cloud resource consumption costs by 25%. – Orchestration: Coordinated complex failure-recovery workflows using Apache Airflow and Azure Data Factory. – Integration: Synced CRM and Redshift data to create interactive Power BI reports, enhancing organizational analytical efficiency.
Scion
Feb 2020 - Jul 2021
1 year 6 months
MSBI Developer
Sep 2020 - Jul 2021
11 months
– Hybrid Analytics: Spearheaded Azure Synapse projects integrating SAP data extracts, delivering the project 15% ahead of schedule. – Validation: Automated ETL testing using Python scripts, increasing data accuracy and reducing manual testing effort by 50%. – Modeling: Developed and tuned SSAS multidimensional models to ensure optimal query performance for enterprise-level reporting.
MSBI Developer
Feb 2020 - Sep 2020
8 months
– ETL Optimization: Improved legacy SSIS performance by 30%, ensuring timely data availability for flight operations and enterprise reporting. – Visualization: Delivered automated dashboards using Tableau and Power BI, achieving a 35% faster report turnaround.
Education
Unknown
Master of Science, International Project Management
2022 - 2024
2 years 4 months
Unknown
Bachelor of Science, Computer Science
2017 - 2020
3 years 6 months
Licenses & certifications
AZ-900: Azure Fundamentals
Issued: –
Certified Data Engineer Associate
Issued: –
PL-300: Power BI Data Analyst Associate
Issued: –
DP-203: Azure Data Engineer Associate
Issued: –