Data Engineer

Job Requirements

As a Fabric Data Engineer, you will be responsible to design, develop and optimize enterprise-scale data solutions leveraging Microsoft Fabric. You will work closely with cross-functional teams to integrate data from various sources, including SAP ERP and non-ERP systems. The ideal candidate will possess strong expertise in PySpark, Python,SQL Fabric Lakehouse, Data Factory and Data Warehousing.

Work Experience

• Design and implement data integration solutions using Microsoft Fabric.
• Integrate data from API, SAP ERP and non-ERP sources like Zoho CRM, Wrench, ManageEngine ITSM tool, Sourcing Tool, HRMS, and other digital solutions.
• Develop and maintain ETL processes using PySpark and Python to ensure data accuracy and consistency.
• Design, develop and maintain scalable data pipelines using Microsoft Fabric.
• Develop solutions leveraging Fabric Lakehouse, Data Warehouse, Notebooks and Data Factory.
• Implement medallion architecture (Bronze, Silver, Gold) for enterprise data platforms.
• Perform data transformation, cleansing, validation and enrichment activities.
• Develop reusable frameworks and accelerators for data processing.
• Collaborate with business stakeholders to understand data requirements and deliver actionable insights.
• Create and optimize data models and dashboards in Power BI.
• Monitor and troubleshoot data integration workflows to ensure optimal performance.
• Good exposure on Fabric Administration, Governance, Monitoring and Automation.
• Document data integration processes and provide training to end-users.
• Communicate with IT business partners to elicit, analyze, communicate, document, and validate requirements.
• Documentation and adherence to change control policies & procedures of software development or project management lifecycle methodologies.

Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proven experience as a Data Engineer, with expertise in Microsoft Fabric and Power BI.
• Strong knowledge of SAP ERP and non-ERP systems integration.
• Proficiency in ETL tools and techniques.
• Experience with data modeling and visualization in Power BI.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.