Data Engineer II

Data Engineer II role focused on improving and maintaining scalable data pipelines and products supporting a world-class experimentation platform in Bengaluru.

Key Responsibilities

Own multiple data pipelines and products, providing innovative solutions to reduce operational workload; develop next-generation scalable and high-performance data pipelines; contribute to development of data platform capabilities like testing, monitoring, debugging, and alerting; resolve data and pipeline issues prioritizing customer impact; maintain end-to-end data quality; innovate with new tools for performance, scaling, and data quality; provide tools for analytics community to discover data and assess quality; act as main contact for technical and business stakeholders on data engineering issues.

Requirements

Java, Python, production data pipelines in the cloud, data-lakes, server-less solutions, schema design, data modeling, load balancer (lb), databases (db), caching, NoSQL, Flink, CDC, Kafka, Airflow, Spark, Snowflake, DBT, testing, alerting, monitoring, debugging, security, big data, data engineering, software engineering, developing data pipelines and products