Big Data Developer

Key Responsibilities

• Design and implement highly available and scalable big data architectures, including Lambda and Kappa architectures.
• Develop, maintain, and optimize large-scale data processing platforms and related modules.
• Optimize the performance of big data frameworks such as Spark and Flink.
• Troubleshoot data processing pipelines, including task performance, memory usage, processing efficiency, and system stability.
• Collaborate with data analysts, algorithm teams, and other technical teams to deliver efficient data interfaces, services, and supporting tools.
• Participate in technical solution design, development documentation, and implementation.
• Translate business requirements into practical data solutions that support business growth.