Senior Data Engineer

Role & responsibilities

Role: Senior Data Engineer

Experience: 10+ years
Key Responsibilities

Location: bp Pune office with minimum 3 days per week in the bp office.

• Excellent communicator and experience of working in distributed geographical teams. Previous experience of working in a client facing role is advantageous.
• Coordinate effectively with distributed teams across multiple time zones.
• Lead the design, development, and optimization of scalable data pipelines, data processing frameworks, and enterprisegrade Python applications.
• Provide technical leadership in Python development, including best practices for automation, data processing, and integration workflows.
• Drive agile delivery by collaborating with crossfunctional teams under Agile/Scrum methodologies.
• Work extensively with Python and datacentric libraries such as NumPy, Pandas, BeautifulSoup, Selenium, pdfplumber, and Requests.
• Architect and optimize SQL queries and database solutions, with strong proficiency with relational data stores, data modelling and design.
• Integrate DevOps practices using CI/CD pipelines, Jenkins, Git, and ensure smooth deployment of data solutions.
• Develop and manage cloudbased data workflows on platforms such as AWS. Airflow and Azure Databricks.
• Exposure to Generative AI and proficiency in using GenAI tools such as Github co-pilot and Claude Code