Data engineer

Educational RequirementsBachelor of Engineering,BTech,MCA,MTech,MSc Service Line Strategic Technology GroupResponsibilities

• Design, develop, and implement scalable data engineering solutions using modern Big Data technologies.
• Build and maintain large-scale digital platforms, marketplaces, and data-driven applications.
• Work on complex engineering projects utilizing cloud-native architectures and distributed systems.
• Collaborate with cross-functional teams, architects, and fellow Power Programmers to deliver innovative solutions.
• Participate in end-to-end software development lifecycle activities in Agile environments.
• Develop high-performance data pipelines and data processing frameworks.
• Contribute to the architecture, design, coding, testing, and deployment of enterprise solutions.
• Co-create new products, platforms, and technology accelerators for clients.
• Engage with technology communities, open-source initiatives, and user groups.
• Continuously learn and upskill on emerging technologies and industry trends.

Additional Responsibilities:

• Technology->Big Data->Big Data -ALL
• Technology->Big Data - Data Processing-PySpark
• Technology->Big Data - Hadoop-Hadoop-Hive
• Technology-Data Engineering-Databricks
• Technology-Functional Programming-Scala
• Technology-Java-Apache-Kafka
• Technology-OpenSystem-Python - OpenSystem-Python

Technical and Professional Requirements:

• Strong experience in Big Data Technologies
• Hands-on expertise in: Apache Sparko Scalao Hiveo Kafka
• Strong understanding of distributed data processing and data pipeline development.
• Experience working with cloud platforms and cloud-native architectures.
• Proficiency in software engineering best practices, design patterns, and Agile methodologies.
• Strong problem-solving and analytical skills.

Preferred Skills:

• Technology->Big Data->Big Data - ALL
• Technology->Big Data - Hadoop->Hadoop->Hive
• Technology->Java->Apache->Kafka
• Technology->OpenSystem->Python - OpenSystem->Python
• Technology->Functional Programming->Scala
• Technology->Data Engineering->Databricks
• Technology->Big Data - Data Processing->PySpark