Senior Big Data Engineer

We’re looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting.

Responsibilities

• Design, develop, and maintain scalable data processing pipelines using Apache Spark
• Ensure accuracy and efficiency of statistical algorithms implemented in production
• Collaborate with global engineering teams on distributed data architecture and design
• Work with large-scale distributed systems (e.g., Hadoop, Kafka, Cassandra) for data ingestion and processing
• Contribute to the build and optimization of Data Lakes and Data Warehousing solutions
• Support and enhance CI/CD workflows, infrastructure automation, and deployment processes

Requirements

• Python
• Bash scripting
• AWS Cloud (s3 , Lambda , StepFunctions , CloudFormation , CloudWatch , IAM , Redshift , Glue , EMR , VPC , LoadBalancers , MWAA,KMS , Secret Manager , Athena , SQS , ECS, ECR,RDS ...)
• Airflow
• Apache Spark, PySpark
• Iceberg
• SQL
• Familiarity with REST API

Nice to have

• Backend engineering experience

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About Us Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.