Staff Engineer, Big Data Engineer with AWS

We're Nagarro.

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (17500 experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

REQUIREMENTS:

• Total experience: 6+ years.
• Excellent knowledge and experience as Big Data AWS Engineer.
• Strong working experience with architecture and development in Apache Spark, Python, AWS Services (S3, Redshift and EKS), Git, SQL.
• Strong programming expertise in Python and PySpark (Spark)
• Advanced proficiency in SQL
• Hands-on experience with Big Data technologies and distributed data processing frameworks
• Strong experience with AWS ecosystem:

1. Amazon S3 (data lake storage)
2. Amazon Redshift (data warehousing)
3. EKS / Kubernetes (containerized deployments and orchestration)

• Proven expertise in designing and maintaining large-scale ETL/ELT data pipelines
• Experience with workflow orchestration tools (Airflow / Argo or similar)
• Strong understanding of data modeling, partitioning, and performance tuning
• Excellent communication and client-facing skills, with ability to explain technical solutions clearly
• Experience working with large-scale historical datasets and incremental data loads.

RESPONSIBILITIES:

• Writing and reviewing great quality code.
• Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
• Mapping decisions with requirements and be able to translate the same to developers.
• Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
• Defining guidelines and benchmarks for NFR considerations during project implementation.
• Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers.
• Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
• Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it.
• Understanding and relating technology integration scenarios and applying these learnings in projects.