EY-GDS Consulting-AI And DATA-Databricks-Senior

Job Summary

EY GDS - AI And Data - Databricks Data Engineer

We're looking for candidates with strong technology and data understanding in the big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

Responsibilities

• Develop deploy Databricks in a cloud environment
• ETL design, development, and deployment to Cloud Service
• Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams
• Design and optimize model codes for faster execution
• Collaborate with cross-functional teams to manage project timelines and deliverables

Skills and attributes for success

• 3-5 years of experience in developing data ingestion, data processing, and data migration, relational databases, and data warehouse solutions
• Hands-on experience with Databricks
• Proficiency in PySpark
• Knowledge of ETL/ELT processes and data pipeline orchestration.
• Experience with Delta Lake, Lakehouse architecture.
• Proficiency in Python
• Knowledge of using Unity Catalog and security best practices.
• Develop data ingestion workflows from multiple sources (SQL Server, APIs, flat files, cloud storage).
• Optimize SQL queries and Spark jobs for performance and scalability.
• Experience with Azure components especially ADF, ADLS etc.
• Experience in implementing complex data transformations
• Knowledge in Data Streaming
• Knowledge in DevOps and CI/CD deployments
• Must have hands-on experience in SQL and procedural SQL languages
• Strong analytical skills and enjoys solving complex technical problems
• Proven ability to lead teams, manage resources, and drive projects to successful completion

To qualify for the role, you must have

• Be a computer science graduate or equivalent with 3-5 years of industry experience
• Have working experience in an Agile-based delivery methodology (preferable)
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution
• Proficiency in software development best practices
• Excellent debugging and optimization skills
• Experience in enterprise-grade solution implementations in converting business problems/challenges to technical solutions considering security, performance, scalability, etc.
• Excellent communicator (written and verbal, formal and informal)
• Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support
• Client management skills
• Demonstrated leadership experience with the ability to manage and mentor team members effectively
• Knowledge of run/change operations

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.