Data & Automation Engineer - AI & Cloud Data Platforms

Key Responsibilities:

1. Data Pipeline Development

• Design and build scalable ETL/ELT pipelines for modern data platforms in MS Fabric.
• Develop automation solutions using Python and PySpark.
• Implement cloud-native data pipelines on Azure.

2. Platform Architecture & Maintenance

• Build and maintain Lakehouse / Data Warehouse architectures.
• Develop and optimize pipelines on Microsoft Fabric.
• Improve performance, cost efficiency, and reliability of existing data systems.

3. AI & Analytics Enablement

• Support AI/ML and GenAI workloads by building data pipelines for model training and inference.
• Collaborate with analytics teams to enable high-quality data models and insights.

4. Inhouse Development

• Desing and developing interactive dashboards.
• Desing and develop inhouse application using Python, Django, PySpark, SQL etc.
• Develop future ready chat bots/natural query base dashboards using different AI models, integrating with fabric data.
• Maintain and support all internal application as per key responsibility.