Data Engineer

Experience: 5 to 10 yrs

Required Skills

Programming Data Processing

• Strong proficiency in Python or Java.

• Experience in Python-based data extraction and logic development.

• Hands-on experience with Apache Kafka, Apache Spark, ANSI SQL, and FTP.

• Experience in on-premises to AWS cloud migration.

Data Formats

• Strong understanding of JSON, Avro, and Parquet file formats.

Platforms Technologies

• Experience with Hadoop (HDFS/Hive).

• Hands-on experience with Snowflake, Apache Iceberg, and Sybase IQ.

Data Modeling Architecture

• Understanding of data normalization and denormalization techniques.

• Knowledge of natural keys and surrogate keys and their strategic use in data modeling.

  Key Responsibilities

• Develop and maintain data extraction and transformation pipelines.

• Build scalable data processing solutions using Apache Spark and Kafka.

• Work with structured and semi-structured data formats.

• Support on-premises to AWS cloud migration projects.

• Design and optimize SQL queries for efficient data processing.

• Implement data modeling strategies using normalization, denormalization, and appropriate key selection.

• Work with Hadoop, Snowflake, Apache Iceberg, and Sybase IQ platforms

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.