Databricks Architect

We're seeking a skilled Databricks Architect to join CODVO.AI's Engineering team and lead the design, implementation, and optimization of data solutions on the Databricks platform. In this role, you'll architect scalable data pipelines, mentor technical teams, and provide strategic guidance to ensure our clients and internal systems leverage Databricks to its full potential. Your expertise will directly impact how we deliver cutting-edge data engineering solutions to enterprise clients.

What You'll Do

• Design and architect enterprise-grade data solutions on Databricks, including data lakes, lakehouses, and analytics platforms that meet scalability and performance requirements
• Lead implementation projects from discovery through deployment, ensuring best practices in data governance, security, and cost optimization
• Develop and optimize complex data pipelines using Spark, Delta Lake, and Databricks SQL to handle large-scale data processing
• Provide technical support to development teams and clients, troubleshooting issues, performance bottlenecks, and architectural challenges
• Establish standards and frameworks for Databricks deployments, including cluster configuration, workspace management, and access control policies
• Mentor junior engineers and conduct technical reviews to elevate team capabilities and ensure code quality
• Collaborate with stakeholders to gather requirements, translate business needs into technical specifications, and deliver solutions aligned with organizational goals
• Stay current with Databricks platform updates, new features, and industry best practices, sharing knowledge with the team

What We're Looking For

Required Qualifications:

• 3+ years of hands-on experience with Databricks platform and data engineering
• Databricks Certified Associate or Databricks Certified Professional certification
• Strong proficiency in Apache Spark, Python, and SQL
• Demonstrated experience designing and implementing data pipelines and ETL/ELT processes
• Solid understanding of cloud platforms (AWS, Azure, or GCP) and their data services
• Experience with Delta Lake and data governance frameworks
• Excellent problem-solving skills and ability to work independently in a remote environment
• Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders

Nice to Have

• Databricks Certified Solutions Architect certification
• Experience with machine learning workflows and MLflow
• Knowledge of data warehousing concepts and dimensional modeling
• Familiarity with infrastructure-as-code tools (Terraform, CloudFormation)
• Experience with real-time streaming data and Kafka integration
• Background in financial services, healthcare, or other regulated industries
• Contributions to open-source data projects