Databricks & AWS Data Engineering Architect

Job Title: Databricks & AWS Data Engineering Architect

Job Location: San Diego, California

Job Type: Permanent

Job Description

⦁ Create business requirement documents covering functional and non-functional requirements, basis information gathered as part of workshops and interviews with client stakeholders

⦁ Review, propose, and develop solution architecture, ensuring application design aligns with the proposed framework and which are scalable, reliable and maintainable

⦁ Assess and recommend suitable technologies, tools and platforms for implementation as a part of architectural design, to meet business requirements

⦁ Review technical solutions and develop strategies for integration with different technologies and systems, to ensure seamless communication and data flow

⦁ Resolve complex technical challenges during build, deployment, and support phases while promoting reusable frameworks and artifacts

⦁ Provide specialized insights to development team and build collaborative relationships with clients and internal teams, securing successful execution of projects

⦁ Identify potential risks in the system landscape, monitor system performance and suggest optimization initiatives in line with business requirements and long-term objectives

⦁ Establish and uphold comprehensive knowledge base to guarantee that vital information is systematically recorded and readily available

⦁ Contribute to proposals and RFPs by delivering insights related to architectural solutions, for successfully delivering the proposed solutions

Your contribution to the team:

⦁ Expertise in designing and reviewing solution architectures that align with business goals.

⦁ The ability to provide architectural insights to strengthen solution proposals and ensure successful delivery.

⦁ A strategic mindset to align technical solutions with business goals and market trends.

⦁ Proactively drive initiatives to ensure smooth execution and transition of projects.

⦁ The ability to engage with clients and internal teams to build strong and productive relationships.

⦁ Passion for mentoring and fostering a knowledge-sharing culture.

Required Skill and Experience

• Hands on experience in Data Engineering, Data Warehousing, and Data Architecture.

• Strong hands-on expertise in Databricks, PySpark, SQL, and AWS.

• Proven experience leading enterprise-scale migration and modernization programs.

• Experience in CI/CD, data governance, and engineering best practices.

• Strong stakeholder management and technical leadership skills.

Preferred Skill and Experience

• Experience leveraging AI accelerators for code generation, code review, testing, and deployment automation.

• Data quality frameworks, validation controls, monitoring, observability, and root-cause analysis