Data Engineer

Job Posted On: May 29, 2024

• Full Time
• Bengaluru

Qualifications & Skills

• Strong understanding of data architectures, data modelling principles, and ETL processes.
• Proficiency in SQL (e.g., MySQL, PostgreSQL) and experience with big data querying languages (e.g., Hive, Spark SQL).
• Experience with scripting languages (Python, Bash) for data manipulation and automation.
• Experience with distributed data processing frameworks (Spark, Hadoop) (preferred).
• Familiarity with cloud platforms (AWS, Azure, GCP) for data storage and processing (a plus).
• Experience with data quality tools and techniques.
• Excellent problem-solving, analytical, and critical thinking skills.
• Strong communication, collaboration, and teamwork abilities.

EXPERIENCE

Over 4 years

Roles & Responsibilities

• Design, develop, and maintain scalable data pipelines for efficient data extraction, transformation, and loading (ETL) processes.

• Architect and implement data storage solutions, including data warehouses, data lakes, and data marts, aligned with business needs.

• Implement robust data quality checks and data cleansing techniques to ensure data accuracy and consistency.

• Optimize data pipelines for performance, scalability, and cost-effectiveness.

• Collaborate with data analysts and data scientists to understand data requirements and translate them into technical solutions.

• Develop and maintain data security measures to ensure data privacy and regulatory compliance.

• Automate data processing tasks using scripting languages (Python, Bash) and big data frameworks (Spark, Hadoop).

• Monitor data pipelines and infrastructure for performance and troubleshoot any issues.

• Stay up to date with the latest trends and technologies in data engineering, including cloud platforms (AWS, Azure, GCP).

• Document data pipelines, processes, and data models for maintainability and knowledge sharing.

• Contribute to the overall data governance strategy and best practices.

LOCATION

Bengaluru

APPLICATION DEADLINE