Senior Data Engineer

Berkadia Services India Pvt Ltd   

-----------------------------------------------------------------------------------------------  

Integrity is Everything I We Take the Long View I We believe People Matter I We Stand for Excellence I We Love our Jobs I We Innovate  

Job title:         Senior Data Engineer

Department:  Innovation Technology

Location:          Bangalore

Full Time – Hybrid work model (subject to Berkadia policy changes)

Working Hours  Split Shift (3:00pm to 12:00am)   

The Opportunity 

As a member of the Data Pipeline team you’ll be at the center of building our platform that enables us to redefine the Commercial Real Estate industry. We’re building a data pipeline that merges with the tested design of data warehousing and the latest big data technologies. You will be designing and building data projects while securing core data elements. 

 

In this role, individual will be required to work on one or multiple aspects of Innovation verticals with the following key responsibilities –    

• Research new technology and share knowledge with team and peers

• Design, implement and release data applications in AWS using big data technologies

• Coordinate development efforts across the organization

• Influence team in development standards and processes

• Teach and mentor peers

• Other duties as assigned

 

 

Your Qualification 

Education:  

• Bachelor’s degree in information technology, Computer Science, Data Engineering, Information Systems, or a closely related technology field; or equivalent practical experience.

• Preferably Post Graduate degree with a focus in Computer Science, Machine Learning, Data Engineering or Data Science.

Qualifications: 

Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experience required: 

• 7+ years of professional experience in data engineering or a closely related field.

• 5 - 7 years of hands-on data engineering with end-to-end ownership of optimized ingestion & transformation data flows.

• Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar.

• 5+ years of experience building high-performance algorithms in scalable languages such as Scala, Python and R

• Strong expertise in SQL (complex queries, performance tuning, analytical functions) & Python (PySpark).

• Proven ability to understand complex requirements, provide concise updates and maintain project timelines.

• Proven experience mentoring junior engineers and performing code reviews

• Strong logical, analytical, problem solving and reporting skills

• 5+ years’ experience with cloud computing in AWS (EMR, AirFlow, Spark, S3, etc)

• Experience with modern data warehousing and/or lakehouse architecture.

• Well versed with CI/CD, Git, and agile development practices.

• Experience managing large scale products with a passion for quality/efficiency and enforcement of best practices.

Perks & Benefits  

Berkadia offers the best-in-class benefits to enable an enjoyable work environment for the employees. Key benefits include – 

• Leaves: Berkadia offers a comprehensive leave policy that not only helps you to plan holidays and personal milestones, but also covers exigencies such as sickness and bereavement.

• Transportation: Berkadia offers free transportation to every employee, irrespective of their shift timings.

• Medical Insurance: Berkadia has an inclusive medical insurance policy that covers the family members of the employees, including parents.

• Learn while you Earn: Berkadia encourages employees to learn new skills by sponsoring degrees, certifications, training, and workshops.

• Wellness: Berkadia has an extensive wellness program that includes annual health check, eye checkup, dental screening, OPD reimbursement, and Employee Assistance Program.