Smida Marwen

The implementation of pipelines to collect and process data from various sources to feed BI dashboards with metrics that would be consulted by Baker Hughes and its clients with the aim of optimizing drilling trajectories, reducing drilling time, and minimizing operating costs. Tasks: - Implementation and automation of infrastructure with Terraform in AWS. - Setting up the entire processing chain: Spark jobs on EMR, orchestration using Airflow. - Implementation of CI/CD on Jenkins. - Monitoring, debugging, and handling of incidents. - Assisting BI teams in optimizing their SQL queries. - Data cleaning for datasets used by data scientists. - Assisting data scientists in industrializing their models. - Collaboration with multidisciplinary teams, including geologists, reservoir engineers, and business analysts, to understand data needs and provide data-driven solutions. - Documentation writing. - Optimization of Spark jobs and queries to ensure efficient data processing. - Brainstorming, sprint planning, participation in Scrum ceremonies. - Technical study and estimation of new features. - Code review (Clean Code, Design Patterns).

Setting up a scalable solution for the hotels chain to centralize data from various sources, transform and enrich it, and then use it to evaluate performance, make strategic pricing decisions, assess the effectiveness of offered services, and visualize market changes. Tasks: - Create Kinesis streams to ingest reservation data and develop Lambda functions to process reservation data. - Set up a pipeline to collect data from various sources. - Transform, enrich, and cross-reference data from different sources using Spark jobs launched on EMR to feed Datamarts on Redshift. - Use Apache Airflow orchestration tool to schedule and automate ETL task execution. - Implement and automate infrastructure using Terraform in AWS. - Develop an automated ETL pipeline to analyze customer data and predict their buying behavior. - Create comprehensive documentation for ETL pipelines, including data flows, transformations, and integration points with the online reservation API. - Data cleaning for datasets used by data scientists. - Support data scientists in industrializing their models.

Migration and Restructuring of a Django Monolith to a microservices Architecture with Spring Boot on AWS. Tasks: - Design and implementation of independent microservices, each responsible for a specific functionality of the system. - Deployment of microservices on Amazon EC2. - Implementation of a robust security module to protect the microservices. - Establishment of CI/CD pipelines to automate unit testing, integration testing, and deployment of microservices. - Bug fixing and follow-up to ensure an optimal customer experience. Technical Environment: Spring Boot, MongoDB, Docker, GitLab, IntelliJ IDEA, Postman, Linux, AWS, Jenkins, Maven.

An application for managing student absenteeism that records student attendance during classes. Tasks: - Implementation of an absenteeism management microservice using QR codes to be scanned during sessions. - Create a notification system to inform administrators of any unusual absenteeism patterns or trends. - Implementation of authentication and authorization mechanisms via Spring Security. - Integration of a feature allowing students to provide comments on courses or provide potential reasons for absence. - Integration of a chat module between teachers and students to facilitate communication outside of classes.