Big Data Developer

We are seeking an experienced Data Engineer to join our team and contribute to the design development and optimization of largescale data platforms The ideal candidate should have strong expertise in Big Data technologies realtime data processing distributed computing and modern data engineering practices The role requires working closely with business stakeholders solution architects data scientists and engineering teams to build scalable and highperformance data solutions

Key Responsibilities
Design develop and maintain enterprisescale data ingestion and processing pipelines
Develop batch and streaming solutions using Hadoop Spark Kafka and NiFi
Build scalable ETLELT frameworks to process structured semistructured and unstructured data
Design and implement realtime data streaming solutions using Kafka and Spark Streaming
Develop data integration workflows using Apache NiFi
Optimize data processing jobs for performance scalability and reliability
Collaborate with Data Architects and Data Modelers to implement data models and platform architecture
Implement data quality reconciliation monitoring and governance frameworks
Troubleshoot production issues and perform root cause analysis
Ensure adherence to security compliance and data governance standards
Participate in code reviews architectural discussions and technical design activities