Soufiane EL DOUQE

Lead sur la conception et le déploiement de l’architecture data globale sur GCP. - Conception d’une architecture data en médaillon (ingestion, transformation, historisation). - Mise en place de pipelines data avec BigQuery, DBT, Airflow (Cloud Composer) et Spark (Dataproc). - Développement de scripts Python, DAGs Airflow et APIs (Flask) sur Cloud Run. - Mise en place de CI/CD (GitLab, Terraform) et Infrastructure as Code. - Supervision, observabilité et alerting via Elasticsearch, Cloud Logging et Monitoring. - Administration GCP : IAM, Secret Manager, coûts et sécurité. Stack : GCP, BigQuery, DBT, Airflow, Spark, Cloud Run, Docker, Terraform, GitLab CI/CD, Elasticsearch.

Participation à la mise en place d’une plateforme data temps réel pour le suivi logistique. - Implémentation d’une architecture streaming avec Kafka et CDC (Debezium). - Intégration et transformation des données dans Snowflake via DBT. - Orchestration des pipelines avec Airflow. - Développement d’APIs Python (FastAPI) pour l’exposition des données. - Mise en place de CI/CD et supervision via Grafana et Elasticsearch. Stack : Kafka, Debezium, Snowflake, DBT, Airflow, Python, FastAPI, GCP, GitHub Actions.

Développement et exploitation de plateformes Big Data à grande échelle. - Développement et optimisation de jobs Spark (PySpark) et requêtes Hive. - Mise en place et administration de clusters Hadoop/CDP. - Gestion des flux Kafka et supervision via ELK. - Exploitation d’environnements cloud AWS (EMR, S3, IAM). - Participation aux chaînes CI/CD et à l’industrialisation des traitements. Stack : Cloudera, Hadoop, Spark, Hive, Kafka, ELK, AWS (EMR, S3), Python, GitLab.

Big Data : Hadoop, Hive, Nifi, Kibana, Kafka, Elastic Search

• Implementing BIG DATA architecture to analyze statistics of different platforms used by the artists • Design and editing technical specifications. • Extract, analyze and ingest data using Azure SQL Data warehouse. • Feeding Hive tables from SQL DW tables. • Developing algorithms to calculate statistics of the use of the platforms. • Developing algorithms to predict the artists who will buzz and Analysis of correlations. • Developing and optimize complex T-SQL and U-SQL scripts. • Developing a Tabular Azure Analysis services. • Set up Data Factory jobs. • Developing Power BI reports and dashboards. Data analysis: HDInsight/ Hive/ Hadoop/ Python/ Data Factory/ Azure Data Lake/ Machine learning/ SQL Data Warehouse/ Azure Analysis services Data visualization: Power BI

• Design and editing of functional and technical specifications. • Feeding of Hive tables from Json files. • Industrialization of the data export from Hive to SQL server via Sqoop/Oozie. • Developing HiveQL queries to retrieve data from Hive. • Implementing SSIS packages to process data from/to SQL. • Participate in the Azure POC. • Modelling the Data Warehouse. • Optimizing SSIS packages and SQL queries. • Geo Bi. Data analysis : HDInsight/ Hive/ Hadoop/ Python/ Spark/ Azure Data Lake/ Machine learning Data visualization : Tableau Software/ Presto/ SuperSet Microsoft Azure Data Factory/ Sqoop/ Oozie/ AirFlow/NiFi BI : Visual Studio(2015)/ SQL Server (2014,2016)

• Wrote SSIS packages to process data from/to SQL, Flat files and other sources • Analyzed data sources for MS ETL and SSRS Reporting • Designed, created and loaded SSAS cubes • Analyzed and developing SSRS 2008 R2 reports • SQL Database development (tables, stored procedures, functions, etc) • Developing SSAS Cubes and MDX scripts. MS BI 2010 «SSIS, SSAS, SSRS»/ MS 2008 SQL Queries/ SharePoint

• Developing MDX scripts. • Developing with DAX expressions for PowerPivot reports. • Developing ETL packages to process data from/to SQL, Flat files and other sources • Analyzed data sources for MS ETL and Excel Reporting • Designed, created and loaded Olap "cubes" • Analyzed and developing reports • SQL Database development (tables, stored procedures, functions, etc) • Writing complex SQL Stored procedures to generate data for reports. Data analysis : Cegid Planning/ OLAP « MDX » Data visualization : MS Excel « VBA »/ PowerPivot MS SQL Server 2008

• Develop and test Extract, Transformation, and Loading (ETL) modules based on design specifications. • Develop and test ETL Mappings in SSIS • Developing MDX scripts in SSAS. • Developing ETL packages to process data from/to SQL, Flat files and other sources • Analyzed data sources for MS ETL and SSRS Reporting • Designed, created and loaded SSAS cubes • SQL Database development (tables, stored procedures, functions, etc) • Delivering efficient ETL packages and documentation. • Maintenance and support of enterprise ETL jobs. MS BI 2010 « SSIS, SSAS, SSRS»/ MS SQL Server 2008/ Autosys/ SHELL.