Data Engineer

Job Overview:

We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our data engineering team. This individual will play a key role in the design, development, and optimization of our data infrastructure and data pipelines. The ideal candidate has a passion for building scalable, high-performance systems and is eager to broaden their knowledge across the entire data engineering stack, from hardware infrastructure to project development.

Key responsibilities:

• Collaborate with cross-functional teams to design, develop, and maintain data engineering solutions using Scala, Python, and Apache Spark.

• Implementation of new data engineering technologies, frameworks, and tools, such as HDFS, MongoDB, and PostgreSQL, to enhance performance, scalability, and efficiency.

• Understand and optimize hardware and resource consumption for data engineering projects.

• Develop a deep understanding of hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.

• Design and architect high-performance, fault-tolerant, and scalable data pipelines.

• Conduct research and stay current with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.

• Mentor and guide junior team members, fostering a culture of continuous learning and skill development.

• Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.

Requirements:

• 2-3 years of professional experience as a Software Engineer, with a focus on data engineering.

• Keen interest in hardware infrastructure, resource consumption optimization, and data engineering project development.

• Proven ability to work effectively in an Agile development environment and manage multiple priorities.

• Strong problem-solving, analytical thinking, communication, and collaboration skills.