Data Engineer

Location: Noida & Hyderabad

Experience: 5 to 8 Years

No. Of Openings: 1

Job Description

Impressico is looking for data engineers to work on building data ingestion pipelines, their orchestration on its clients’ projects.

• Create and maintain optimal data pipeline architectures
• Optimize data delivery for greater scalability
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using PySpark, SQL and AWS/Azure cloud services
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs
• enabling and running data ingestions from different sources like DB, streaming, files, SFTP.
• performing thorough testing and validation in order to support the accuracy of data transformations and data verification to be used by downstream applications
• Recommend different ways to constantly improve data reliability and quality.

Job Specification

Coding in Python

• Coding in PySpark & Python

• Advance SQL querying

• Hands-on experience in the following: AWS Glue, AWS Lambda, AWS Redshift, AWS Step Function, Kinesis, SNS, SQS, S3, Eventbridge or Azure related services.

• Orchestration experience of data pipelines on-premise or on the AWS cloud including automation

• CICD

• Hands-on experience in ETL tools, frameworks, processes

• Hands-on experience working on a data warehouse

• Hands-on experience working with multiple databases