Data Engineer

Position Summary

The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support business reporting, analytics, and decision-making. This role ensures data is collected, transformed, stored, and made accessible from multiple sources while maintaining data quality, reliability, and performance. The Data Engineer also collaborates with cross-functional teams to develop efficient, cloud-based data solutions and continuously improve data processes.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop and manage data warehouses, data lakes, and databases.
• Integrate data from APIs, cloud platforms, third-party systems, and internal databases.
• Optimize data architecture for performance, scalability, and cost efficiency.
• Ensure data accuracy, integrity, and reliability through monitoring and validation.
• Automate data workflows using Python, SQL, and cloud technologies.
• Manage and optimize cloud-based data infrastructure (AWS, Azure, Databricks).
• Collaborate with business and technical teams to deliver reliable data solutions.
• Troubleshoot data issues and support reporting and data extraction requirements.
• Document data pipelines, architecture, and technical processes.
• Perform testing and validation before production deployment.
• Identify opportunities to improve data quality, automation, and operational efficiency.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, Data Science, Statistics, Information Technology, or a related field.
• 3–5 years of experience in Data Engineering, Data Integration, or a similar role.
• Experience designing and maintaining data pipelines, ETL/ELT processes, and data warehouses.
• Strong proficiency in Python (Apache Spark), SQL, and DAX.
• Experience with Databricks, AWS, Azure, GitHub, Linux, and Power BI.
• Knowledge of data modeling, APIs, data governance, and cloud-based data platforms.
• Familiarity with Agile methodologies (Scrum or Kanban).
• Strong analytical, problem-solving, and communication skills.

Nice to Have

• Experience with Dynamics 365 Business Central, LS Central, Microsoft SQL Server, Tableau, JavaScript, HTML, CSS, or AL.
• Experience working with file formats such as Parquet, CSV, JSON, SQL, TXT, and XLSX.