
Alberto Chong
Lead Data Architect | Confluent Kafka & Azure AI
Salary / Daily rate
2710 Sintra, Portugal
Freelance, open to permanent contract
Skills
Languages
About me
Intro
Data Streams & GenAI Lead with 15+ years building enterprise-scale real-time data architectures using Confluent Kafka, Azure Databricks, and AI automation. Led teams of 7+ engineers in mainframe-to-cloud migrations and event streaming platforms for financial/airline sectors. Specialized in end-to-end data pipeline design, AI integration, and transforming legacy systems into modern data products.
Work experience
CHONGTECHNOLOGIESFreelance
Oct 2020 - Present
6 years 1 month
Remote, OR 97458, USA
Lead Data Streams & Gen AI
Feb 2025 - Present
1 year 9 months
Remote, OR 97458, USA
AIRLINES SECTOR - Data Strategy & Architecture Design: Lead the design, roadmap, and implementation of data architecture strategy initiatives to support real-time event streaming data products and AI use cases to ensures the coherent organization of data across multiple platforms and its availability for key business initiatives. This involves creating blueprints for data management, governance systems to integrate, centralize and maintain the data from many data sources into Strimzi Kafka, Confluent Cloud and LakeHouse. - Data Products Development: Lead the design and support the implementation of large-scale data processing systems capable of handling the volume, velocity, and variety of data that needs to be analyzed and processed leveraging Confluent Cloud and Flink SQL. AI Development: • Support Azure OpenAI integration projects; • Design,implement and support complex automation workflows and automation projects; using n8n. • Building GenAI & LLMs solutions and prototypes into scalable, production-grade applications such assistants, agents, RAG apps with Azure Foundry, Azure Databricks Genie, N8N that demonstrate tangible business value • Collaborate closely with cross-functional teams to identify AI use cases and deliver end-to-end solutions - Innovation and Continuous Improvement: Act as an event streaming ambassador – Enable business units to effectively leverage event streaming platform by providing guidance adoption. Stay up-to-date with industry trends and new technologies. Continuously explore innovative solutions and enhancements to the existing data architecture to improve its scalability, reliability, and efficiency. Collaboration: Work closely with project managers, technical teams to integrate resources and drive the successful end-to-end delivery of data solutions as a service across various technologies and platforms. Define and guide the best practices for data streaming architecture.
Tech Lead Data Operations
Jan 2022 - Jan 2025
3 years 1 month
Remote, OR 97458, USA
FINANCIAL SERVICES SECTOR Project Description: Mainframe Offloading and Datalake Migration from on prem cloudera to Azure Databricks - Monitor Kafka and Databricks clusters and implement necessary adjustments to optimize performance - Keep up to date with platform and service roadmaps - Collaborating with Solution Architects in the design and assessment of solutions and software and data engineering team in the delivery of solutions and services - Identifying bottlenecks and inefficiencies in processes hindering performance or progress and proposing measurable and risk-managed - Reporting against KPIs - Identify and eliminate the root causes of quality issues - Handle incident management, troubleshooting, problems management and resolutions - Monitor and resolve data pipeline and data infrastructure performance issues - Escalate all risks and incidents with speed and clarity - Removing technical blockers for individuals and teams - Manage and maintain Confluent Kafka ecosystem, ensuring its availability and scalability - Lead a remote team of 7 data engineers - Optimize and design operations processes and monitor and improve the efficiency of the existing processes - Collaborate with the data governance teams to design rules and processes - Drive an amazing team culture of focus, fun, and constructive feedback Technologies: ◦ Configuration and monitoring of Confluent Platform Apache Kafka Stack (Zookeeper, KSQLDB, Kafka Connect, Schema Registry, Rest Proxy, Control Center) ◦ Design of topics, producers and consumers according best practices ◦ IBM Infosphere CDC Mainframe for DB2 to Kafka ◦ Monitoring tool: Dynatrace, Prometheus, Grafana, ELK stack ◦ ITSM ServiceNow, Jira and Confluence ◦ Azure Databricks Jobs, SQL Warehouse, Alerts ◦ Unity Catalog ◦ Delta lake medallion architecture ◦ Azure DataLake Gen2 ◦ BMC Control M Orchestration ◦ POC Installation,configuration Trino cluster for data Virtualization ◦ GitHub
Confluent Kafka Platform Consultant
Nov 2021 - Dec 2022
1 year 2 months
Remote, OR 97458, USA
FINANCIAL SERVICES SECTOR Project with emphasis on Lambda architecture end to end near real time ETL data pipeline from Mainframe Db2 to Kafka and to MongoDb to build powerful single view of 360 Bank Clients with different indicators of different commercial products, personal Accounts informations, cards, loans, insurance. Technologies: Installation, Configuration and monitoring Confluent Platform Apache Kafka Stack (Zookeeper, Brokers, KSQLDB, Kafka Connect, Schema Registry, Control Center) ◦ Design of topics , producers and consumers. ◦ IBM Infosphere CDC Mainframe for DB2 to Kafka ◦ Data Pipleines with Kafka Connect Sink(MongoDb) ◦ Data Pipelines Ksqldb Streams Transformations and send to MongoDb
Confluent Kafka Platform Engineer
Oct 2020 - Dec 2021
1 year 3 months
Remote, OR 97458, USA
IOT SECTOR: Project with emphasis on Kappa architecture end to end near real time ETL data pipeline to build modern fast OLAP and help clients to move from business intelligence to continuous intelligence and alerts to operations teams. Technologies: ◦ Confluent Apache Kafka Cloud ◦ Installation, configuration and monitoring of KSQLDB cluster ◦ Installation, configuration and monitoring of Kafka Connect cluster ◦ Development and support of Kafka on Confluent Cloud, integrations including, topics consumers and streaming applications. ◦ Kafka Connect Source(CDC Debezium, JDBC) ◦ Kafka Connect Sink(HTTP, BigQuery) ◦ Data Pipelines with Ksqldb Streams ◦ Microservice Spring Boot Kafka Producer ◦ Data Pipelines with Spark Structured Streaming(Pyspark) Jobs on Azure Databricks ◦ Ubuntu 18 TLS ◦ Design Azure DevOps Scrum Methodology(Boards, Sprints, Epics, Features and tasks, repos) ◦ Azure DevOps Pipelines CI/CD to deploy Kafka resources ◦ Ansible Playbooks ◦ Github
Senior IT Consultant
AngolaPrev
Jan 2019 - Mar 2021
2 years 3 months
Luanda, Angola
Sénior .Net Consultant & Data Architect
TEAM LEADER SQL SERVER DBA
DGM Sistemas Lda
Feb 2010 - Aug 2018
8 years 7 months
Luanda, Angola
Team Leader DBA SQL SERVER Project with emphasis in SQL Server Administration using RDBMS SQL SERVER who supported web applications of Identity cards and criminal records of the Angolan Ministry of Justice. Main Activities Database Administrator: Maintenance Plain; Security Policies; Troubleshooting; performance and tunning; Backups strategies; Transactional Replication of Data; ETL to serve external application; Checklist and reports according best practices; Reports for business area Technologies SQL Server 2012 Datacenter; Integration Services; Powershell scripts; Power BI; Reporting Services 2016, Visual Studio 2015, Performance Analysis Logs, SQL Nexus, SQLCopilot
SÉNIOR .NET DEVELOPER
KCS iT
Jan 2009 - Jan 2010
1 year 1 month
Lisbon, Portugal
Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving
.NET Developer
Glintt
Jan 2007 - Jan 2009
2 years 1 month
Lisbon, Portugal
Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving
.NET Developer
Indra
Jan 2007 - Jan 2008
1 year 1 month
Lisbon, Portugal
Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving
.NET DEVELOPER
Novabase
Jan 2006 - Jan 2006
1 month
Lisbon, Portugal
Skills: Interpersonal Skills · Teamwork · Interpersonal Communication · Problem Solving
Education
Universidade Lusófona - Centro Universitário Lisboa
Licentiate degree
2001 - 2005
4 years 1 month
Licenses & certifications
Data Streams Engineer
Issued: Jul 2025
AWS Databricks Platform Architect
Issued: Feb 2025
Databricks Lakehouse Fundamentals
Issued: Mar 2023