Alberto Chong

Lead Data Architect | Confluent Kafka & Azure AI

Salary / Daily rate

2710 Sintra, Portugal

Freelance, open to permanent contract

Skills

LLMs / Large language modelsEvent Driven ArchitectureKafkaDatabricksAWS LambdaRESTful APIsGrafanaMicroservicesAIAzureDevOpsBig DataOracle DatabaseMongoDBSQL databasesAWSAnsibleGitHubSupabaseData EngineeringPythonPostgreSQLPrometheusn8nGoogle Cloud PlatformMySQLMicrosoft SQL Server.NETTerraformDockerElasticsearchLinuxConfluenceKubernetesJira

Languages

English

About me

Intro

Data Streams & GenAI Lead with 15+ years building enterprise-scale real-time data architectures using Confluent Kafka, Azure Databricks, and AI automation. Led teams of 7+ engineers in mainframe-to-cloud migrations and event streaming platforms for financial/airline sectors. Specialized in end-to-end data pipeline design, AI integration, and transforming legacy systems into modern data products.

Links

Work experience

CHONGTECHNOLOGIESFreelance

Oct 2020 - Present

6 years 1 month

Remote, OR 97458, USA

Lead Data Streams & Gen AI

Feb 2025 - Present

1 year 9 months

Remote, OR 97458, USA

AIRLINES SECTOR - Data Strategy & Architecture Design: Lead the design, roadmap, and implementation of data architecture strategy initiatives to support real-time event streaming data products and AI use cases to ensures the coherent organization of data across multiple platforms and its availability for key business initiatives. This involves creating blueprints for data management, governance systems to integrate, centralize and maintain the data from many data sources into Strimzi Kafka, Confluent Cloud and LakeHouse. - Data Products Development: Lead the design and support the implementation of large-scale data processing systems capable of handling the volume, velocity, and variety of data that needs to be analyzed and processed leveraging Confluent Cloud and Flink SQL. AI Development: • Support Azure OpenAI integration projects; • Design,implement and support complex automation workflows and automation projects; using n8n. • Building GenAI & LLMs solutions and prototypes into scalable, production-grade applications such assistants, agents, RAG apps with Azure Foundry, Azure Databricks Genie, N8N that demonstrate tangible business value • Collaborate closely with cross-functional teams to identify AI use cases and deliver end-to-end solutions - Innovation and Continuous Improvement: Act as an event streaming ambassador – Enable business units to effectively leverage event streaming platform by providing guidance adoption. Stay up-to-date with industry trends and new technologies. Continuously explore innovative solutions and enhancements to the existing data architecture to improve its scalability, reliability, and efficiency. Collaboration: Work closely with project managers, technical teams to integrate resources and drive the successful end-to-end delivery of data solutions as a service across various technologies and platforms. Define and guide the best practices for data streaming architecture.

Tech Lead Data Operations

Jan 2022 - Jan 2025

3 years 1 month

Remote, OR 97458, USA

FINANCIAL SERVICES SECTOR Project Description: Mainframe Offloading and Datalake Migration from on prem cloudera to Azure Databricks - Monitor Kafka and Databricks clusters and implement necessary adjustments to optimize performance - Keep up to date with platform and service roadmaps - Collaborating with Solution Architects in the design and assessment of solutions and software and data engineering team in the delivery of solutions and services - Identifying bottlenecks and inefficiencies in processes hindering performance or progress and proposing measurable and risk-managed - Reporting against KPIs - Identify and eliminate the root causes of quality issues - Handle incident management, troubleshooting, problems management and resolutions - Monitor and resolve data pipeline and data infrastructure performance issues - Escalate all risks and incidents with speed and clarity - Removing technical blockers for individuals and teams - Manage and maintain Confluent Kafka ecosystem, ensuring its availability and scalability - Lead a remote team of 7 data engineers - Optimize and design operations processes and monitor and improve the efficiency of the existing processes - Collaborate with the data governance teams to design rules and processes - Drive an amazing team culture of focus, fun, and constructive feedback Technologies: ◦ Configuration and monitoring of Confluent Platform Apache Kafka Stack (Zookeeper, KSQLDB, Kafka Connect, Schema Registry, Rest Proxy, Control Center) ◦ Design of topics, producers and consumers according best practices ◦ IBM Infosphere CDC Mainframe for DB2 to Kafka ◦ Monitoring tool: Dynatrace, Prometheus, Grafana, ELK stack ◦ ITSM ServiceNow, Jira and Confluence ◦ Azure Databricks Jobs, SQL Warehouse, Alerts ◦ Unity Catalog ◦ Delta lake medallion architecture ◦ Azure DataLake Gen2 ◦ BMC Control M Orchestration ◦ POC Installation,configuration Trino cluster for data Virtualization ◦ GitHub

Confluent Kafka Platform Consultant

Nov 2021 - Dec 2022

1 year 2 months

Remote, OR 97458, USA

FINANCIAL SERVICES SECTOR Project with emphasis on Lambda architecture end to end near real time ETL data pipeline from Mainframe Db2 to Kafka and to MongoDb to build powerful single view of 360 Bank Clients with different indicators of different commercial products, personal Accounts informations, cards, loans, insurance. Technologies: Installation, Configuration and monitoring Confluent Platform Apache Kafka Stack (Zookeeper, Brokers, KSQLDB, Kafka Connect, Schema Registry, Control Center) ◦ Design of topics , producers and consumers. ◦ IBM Infosphere CDC Mainframe for DB2 to Kafka ◦ Data Pipleines with Kafka Connect Sink(MongoDb) ◦ Data Pipelines Ksqldb Streams Transformations and send to MongoDb

Confluent Kafka Platform Engineer

Oct 2020 - Dec 2021

1 year 3 months

Remote, OR 97458, USA

IOT SECTOR: Project with emphasis on Kappa architecture end to end near real time ETL data pipeline to build modern fast OLAP and help clients to move from business intelligence to continuous intelligence and alerts to operations teams. Technologies: ◦ Confluent Apache Kafka Cloud ◦ Installation, configuration and monitoring of KSQLDB cluster ◦ Installation, configuration and monitoring of Kafka Connect cluster ◦ Development and support of Kafka on Confluent Cloud, integrations including, topics consumers and streaming applications. ◦ Kafka Connect Source(CDC Debezium, JDBC) ◦ Kafka Connect Sink(HTTP, BigQuery) ◦ Data Pipelines with Ksqldb Streams ◦ Microservice Spring Boot Kafka Producer ◦ Data Pipelines with Spark Structured Streaming(Pyspark) Jobs on Azure Databricks ◦ Ubuntu 18 TLS ◦ Design Azure DevOps Scrum Methodology(Boards, Sprints, Epics, Features and tasks, repos) ◦ Azure DevOps Pipelines CI/CD to deploy Kafka resources ◦ Ansible Playbooks ◦ Github

Senior IT Consultant

AngolaPrev

Jan 2019 - Mar 2021

2 years 3 months

Luanda, Angola

Sénior .Net Consultant & Data Architect

TEAM LEADER SQL SERVER DBA

DGM Sistemas Lda

Feb 2010 - Aug 2018

8 years 7 months

Luanda, Angola

Team Leader DBA SQL SERVER Project with emphasis in SQL Server Administration using RDBMS SQL SERVER who supported web applications of Identity cards and criminal records of the Angolan Ministry of Justice. Main Activities Database Administrator: Maintenance Plain; Security Policies; Troubleshooting; performance and tunning; Backups strategies; Transactional Replication of Data; ETL to serve external application; Checklist and reports according best practices; Reports for business area Technologies SQL Server 2012 Datacenter; Integration Services; Powershell scripts; Power BI; Reporting Services 2016, Visual Studio 2015, Performance Analysis Logs, SQL Nexus, SQLCopilot

SÉNIOR .NET DEVELOPER

KCS iT

Jan 2009 - Jan 2010

1 year 1 month

Lisbon, Portugal

Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving

.NET Developer

Glintt

Jan 2007 - Jan 2009

2 years 1 month

Lisbon, Portugal

Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving

.NET Developer

Indra

Jan 2007 - Jan 2008

1 year 1 month

Lisbon, Portugal

Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving

.NET DEVELOPER

Novabase

Jan 2006 - Jan 2006

1 month

Lisbon, Portugal

Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving


Education

Universidade Lusófona - Centro Universitário Lisboa

Licentiate degree

2001 - 2005

4 years 1 month


Licenses & certifications

Data Streams Engineer

Issued: Jul 2025

Certified by Confluent

AWS Databricks Platform Architect

Issued: Feb 2025

Certified by Databricks

Databricks Lakehouse Fundamentals

Issued: Mar 2023

Certified by Databricks

The best place to find your next move

© 2026. All Rights Reserved.