Yashwanth A

Designing and delivering scalable, secure, and high-performance data engineering solutions on Microsoft Azure. I specialize in building and orchestrating end-to-end data pipelines using Azure Data Factory, Databricks (PySpark), and Synapse Analytics for both real-time and batch processing needs.

Led the design and implementation of scalable cloud infrastructure and CI/CD pipelines to support modern application development and data platforms across Azure and AWS.

Designed and built scalable ETL pipelines using AWS Glue, Lambda, and PySpark for processing and transforming large datasets across S3, RDS, and Redshift. Developed real-time data ingestion and analytics solutions with Amazon Kinesis, Athena, and QuickSight to support business intelligence needs. Automated data workflows, managed metadata with Glue Catalog, and implemented secure, monitored cloud environments using AWS services like EMR, DMS, and CloudWatch.

Designed and maintained scalable ETL pipelines using Azure Data Factory, Synapse, and Data Lake Gen2 for batch and real-time data integration. Automated workflows with Azure Functions, Logic Apps, and built insightful dashboards using Power BI for business reporting.