Cloudera Developer (m/f/d)

Job ID: 744000048698235

Cloudera Developer (m/f/d)

Pune

Professional

Temporary (Part Time Possible)

T-Systems ICT India Pvt. Ltd.

Your Task

We are seeking a Sr Cloudera Developer (Data Engineer) to design, develop, and implement data solutions using Cloudera technologies. This role requires 6 to 10 years of experience and this position is based in Pune.

Responsibilities

• Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive
• Collaborate with data engineers to optimize data pipelines and data processing workflows
• Work closely with data analysts and data scientists to ensure data quality and integrity
• Troubleshoot and resolve issues with data processing and data storage systems
• Stay up-to-date on the latest trends and best practices in Cloudera development
• Participate in code reviews and provide feedback to team members
• Perform Extract Transform and Load (ETL) processes using Spark
• Deploy and manage Spark applications on a Hadoop cluster or on GCP Dataproc

Your Profile

We are seeking a highly skilled Sr Cloudera Developer (Data Engineer) with 6 to 10 years of experience, possessing strong expertise in Spark, Hadoop ecosystem, cloud technologies, and data engineering practices.

Must Have Skills

• 6 to 10 years of experience
• Proficiency in working with Spark
• Understanding of Spark's architecture and fault tolerance mechanisms
• Proficiency in using Spark DataFrames and Spark SQL for querying structured data
• Skills in performing Extract, Transform, and Load (ETL) processes using Spark
• Strong knowledge of Python
• Knowledge of DevOps tools and practices including CI/CD and Docker
• Hands-on experience in GCP services including Dataproc, Cloud Function, Cloud Run, Pub/Sub, and BigQuery
• Bachelor's degree in Computer Science, Information Technology, or a related field
• Proven experience as a Cloudera Developer or similar role
• Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive
• Experience with data modeling, data warehousing, and data integration
• Strong programming skills in Java, Scala, or Python
• Excellent problem-solving skills
• Excellent communication skills
• Ability to work independently and as part of a team

Nice to Have Skills

• Experience in optimizing Spark execution plan
• Experience with integrating Spark Streaming with other technologies like Kafka
• Familiarity with the Hadoop ecosystem including tools such as HDFS, Hive, and Cloudera stack
• Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc
• Experience with Java

About Us

T-Systems Information and Communication Technology India Private Limited (T-Systems ICT India Pvt. Ltd.) is a proud recipient of the prestigious Great Place To Work® Certification™. As a wholly owned subsidiary of T-Systems International GmbH, T-Systems India operates across Pune, Bangalore, and Nagpur, boasting a dedicated team of 3500+ employees providing services to group customers.

T-Systems offers integrated end-to-end IT solutions, driving the digital transformation of companies in all industries, including automotive, manufacturing, logistics, and transportation, as well as healthcare and the public sector. T-Systems develops vertical, company-specific software solutions for these sectors.

T-Systems International GmbH is an information technology and digital transformation company with a presence in over 20 countries and a revenue of more than €4 billion. T-Systems is a world-leading provider of digital services and has over 20 years of experience in the transformation and management of IT systems.

As a subsidiary of Deutsche Telekom and a market leader in Germany, T-Systems International offers secure, integrated information technology and digital solutions from a single source.