Data Engineer

HI All , We have openings for Data Engineer position for Hyderabad and Chennai Location

Role & responsibilities

Job Title: Data Engineer
Position: Software Engineer
Experience: 3-8 Years
Category: Software Engineering
Shift: 5.30PM to 2.30AM shift
Work Mode: Hybrid Mode
Primary Location: Chennai / Hyderabad

Mandatory Skills : Data Engineer , Snowflake , AWS services , Databricks

Job Description:

Strong end to end data engineering experience.
. Hands on expertise in Snowflake and/or Databricks with AWS.
. Ability to design and implement scalable data engineering solutions.
. Strong troubleshooting and performance optimization skills.
. Ability to independently work with business and technicalstakeholders.
. Experience mentoring junior data engineers is an advantage.

Key Responsibilities :

. Design, develop and maintain scalable data pipelines and data engineering solutions.
. Develop data ingestion, transformation and processing workflows using cloud based technologies.
. Work with Snowflake and Databricks to build and optimize data processing and analytical solutions.
. Develop and maintain data pipelines using AWS Glue, S3 and Lambda.
. Implement data transformation, cleansing, validation and integration processes.
. Develop efficient SQL queries and optimize data processing and warehouse workloads.
. Work with business and technical teams to understand data requirements and translate them into technical solutions.
. Participate in solution design, development, testing and deployment activities.
. Develop reusable components and follow established data engineering and coding standards.
. Troubleshoot data pipeline and application issues and implement appropriate fixes.
. Participate in code reviews, technical discussions and continuous improvement initiatives.
. Support deployment and release activities across environments.
. Monitor data pipelines and proactively identify issues affecting data processing or availability.
. Provide support for production issues when required, including troubleshooting and root cause analysis.
. Maintain technical documentation and operational procedures.

Key Mandatory Skills :

Data Engineering

. Strong understanding of data engineering concepts, ETL/ELT and data pipelines.
. Hands on experience with Snowflake and/or Databricks.
. Experience building data pipelines and data transformation workflows.
. Strong SQL skills.
. Good understanding of data modelling and data warehousing concepts.

AWS
Hands on experience with one or more of the following:

. AWS Glue
. Amazon S3
. AWS Lambda

Experience with additional AWS data services will be an advantage.
Databricks

. Databricks data engineering
. Data transformation and processing
. Delta Lake
. PySpark and/or Spark
. Notebook based development

Snowflake

. Snowflake development
. Data loading and transformation
. SQL development
. Data warehouse concepts
. Performance optimization

Interested please share the resumes to [email protected]

Thanks & Regards

Sridhar