Data Engineer

Job Overview
We are seeking a dynamic and highly skilled Data Engineer to join our innovative data team. In this role, you will be at the forefront of designing, developing, and maintaining scalable data pipelines and architectures that empower data-driven decision-making across the organization. Your expertise will enable us to harness the power of big data systems, cloud platforms, and advanced analytics tools to deliver actionable insights. If you thrive in a fast-paced environment and are passionate about building robust data solutions, this opportunity is perfect for you!

Duties

• Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to facilitate seamless data flow from diverse sources such as AWS, Azure Data Lake, and on-premises SQL databases.
• Design and maintain scalable data models and data warehouse architectures using dimensional modeling techniques to support business intelligence and analytics initiatives.
• Collaborate with cross-functional teams to gather requirements and translate them into efficient data solutions utilizing tools like Informatica, Talend, Apache Hive, Spark, and Hadoop.
• Manage large-scale big data systems by leveraging technologies such as Hadoop, Spark, and Apache Hive to process vast amounts of structured and unstructured data.
• Integrate linked data sources and develop RESTful APIs for real-time data access and application integration.
• Ensure data quality, security, and compliance across all platforms while maintaining optimal query management practices.
• Support model training, analysis tasks, and business intelligence reporting using Looker or similar visualization tools to deliver clear insights to stakeholders.

Skills

• Extensive experience with cloud-based platforms such as AWS, Azure Data Lake, and Public Cloud environments for scalable data storage and processing.
• Proficiency in programming languages including Java, Python, Bash (Unix shell), and Shell Scripting for automation and pipeline development.
• Strong knowledge of big data systems like Hadoop ecosystem components (HDFS, MapReduce), Spark, Apache Hive, and related technologies.
• Expertise in SQL databases such as Microsoft SQL Server, Oracle, SQL Server Management Studio (SSMS), along with experience in SQL query management and database design.
• Skilled in data management integration tools like Informatica and Talend for efficient ETL pipeline development.
• Solid understanding of data modeling principles including dimensional modeling for data warehousing design.
• Familiarity with business intelligence tools such as Looker for creating dashboards and visualizations that support strategic decision-making.
• Experience with cloud databases like Azure Data Lake or other cloud-native solutions for scalable analytics workloads.
• Knowledge of RESTful API development for integrating various applications with backend data systems.
• Strong analysis skills combined with a proactive approach to problem-solving within agile environments to continuously improve data processes.

Join us to be part of a forward-thinking team dedicated to transforming raw data into powerful insights that drive innovation!

Pay: $112,000.00 - $136,000.00 per year

Work Location: In person