Houssem Alayet

Crédit Agricole September 2024 - Present ● Develop Spark jobs, SQL queries ● Depelovp data pipelines on Cloudera environment (Spark, Scala, Kafka, HBase, Hive etc) ● Industrialize data pipelines and ensure the freshness and integrity of data from various sources. METRO France April 2023 - September 2024 ● Develop BigQuery queries, SSIS and SSAS packages ● Change data pipelines sourcing on GCP ● Industrialize data pipelines and ensure the freshness and integrity of data from various sources. TECHNICAL AND FUNCTIONAL ENVIRONMENT: ● Sector: Retail ● Languages: SQL, Python ● Tools: GCP, BigQuery, Dataflow, Composer (Airflow), Visual Code, github, Jira, Microsoft SQLServer, SSIS, Microsoft Visual Studio 2019 ● Methods: scrum, agile Orange France February 2022 - April 2023 ● Setting up the architecture and selecting cloud services for migrating to GCP ● Developing, switching and deploying the new pipelines of data processing on GCP TECHNICAL AND FUNCTIONAL ENVIRONMENT: ● Sector: Telecom ● Languages: SQL, Terraform ● Tools: GCP, BigQuery, Dataflow, Apache Kafka, Visual Code, Gitlab, Jira, Microsoft SQLServer, SSIS, Microsoft Visual Studio 2019 ● Methods: scrum, agile

May 2019 - January 2022 : Working for Leroy Merlin, Digital & Data Factory - Create and maintain optimal data pipelines. - Assemble large, complex data sets that meet functional / non-functional business requirements. - Create data tools for analytics and data scientist team members that assist them in building and optimizing products and solutions. - Develop back-end APIs for the front-end applications and dashboards. - Industrialize data pipelines and ensure freshness and integrity of data coming from various sources. Environment: Python, SQL, Google Cloud Platform, BigQuery, Airflow, Kestra, Django-rest-framework, git, GitLab, OpenShift, JIRA.

- Involved in importing and exporting data from local/external file system and RDBMS to HDFS. Load log data into HDFS using Flume. - Developed Spark code using scala and Spark-SQL/Streaming for faster testing and processing of data. - ETL Data cleansing, Integration and Transformation using Pig. Tools: Hortonworks, Scala, Java, HBase, Hive, Spark, Flume, Kafka

Development of an end-to-end Big Data tool to track the evolution and activity of Facebook pages and their respective posts in Near-Real-Time : - Collecting and scraping data from Facebook using a Python code and a Flume Agent in Near-real-time. - Streaming of the collected data with an Apache Spark job, parsing it and storing it in HBase. - Indexing with Lily-HBase Indexer and creating a dashboard with Apache Solr. Keywords: CentOS, Cloudera, Flume, Spark, HBase, Solr, sbt

Development of a Customer Value Management Tool using Big Data Technologies and Machine Learning for a client in the Telecom Industry Tasks include: - Cluster installation - Data ingestion, Data preparation & analysis - Campaign configuration & validation - Data vizualization and dashboard creation - Benchmarking, implementation & improvement of ML algorithms Keywords: Hortonworks, MapReduce, Python, SQL, Hive, HDFS, HBase, Phoenix, Clustering, Airbnb Superset, Microsoft Azure

Study of the IP/MPLS network of Tunisie Télécom and optimisation of the positionning of the LSPs within the network. Keywords : IP/MPLS, research, study, mathematical modelling, game theory, algorithms

- Configuring modems, routers and switchers - Handeling the day-to-day operations - fixing fiber-optics related issues and malfunctions - Getting familiar with the different departments, tools and equipments.