
Rachid Berkane
Consultant Senior Big Data | DevOps & AWS
Salaire / Taux journalier
Paris, France
Freelance
Peut venir sur site
Expertises
Langues
À propos
Introduction
BigData Platform Consultant with 15+ years expertise in Cloudera CDP, AWS, and DevOps across major enterprises. Proven track record in Hadoop cluster migrations, cloud architecture, and SRE practices at ArcelorMittal, Société Générale, and Banque de France. Specialized in on-prem to cloud migrations and performance optimization.
Expérience de travail
Ingénieur Plateformes Big Data - Cloudera CDP
ArcelorMittalFreelance
sept. 2023 - Présent
3 ans 2 mois
Consultant Plateformes Big Data, Administrateur Hadoop/Cloudera, MLOps, SRE - installation/administration de cluster Big Data on Prem : Cloudera CDP private cloud 7.1.9 ( Apache Hadoop, YARN, HIVE, Impala, Kudu, Kafka, SOLR, HBase, ..) - migration inter cluster Hadoop ( en parallel run ) - gestion des habilitations : Authentification AD/Kerberos, Authorisations/audits via apache Ranger - mise en place d'un PRA/DRP (plan de reprise d'activité/Desaster Recovery Plan) : replication de données HDFS/Hive onPrem vers un cluster dans le Cloud AZURE - tests de restauration - installation de clusters Cloudera public cloud dans AZURE ( cluster storage + clusters de calculs ) - interropérabilité onPrem/Cloud - installations Talend: Talend runtime, Talend Remote Engine - support aux Data engineers / Data analysts: PySpark3, BI, - migrations: python ( 2/3.6 -> 3.8 à 3.11), migrations Java 8 à Java 11/17, RedHat 7 -> RedHat 8.8 - tunning performances: YARN, HIVE, réplications vers le cloud
Cloud & Big Data - Architecture, Build and Run Consultant
Crédit Agricole Group Infrastructure PlatformFreelance
déc. 2022 - juil. 2023
8 mois
Skills: Architecture de solution · Architecture
Consultant BigData
Societe Generale
févr. 2022 - oct. 2022
9 mois
Environnements/technologies : Cloudera CDP 7.1.5, HDP 2.6, HDF 3.1, Linux (RedHad, Centos. 7.x), ELK 6/7, ansible, jenkins: - Administration des environnements BigData HDP de DEV à PROD : Ambari, HUE, RedHad, (HDFS, YARN, Spark, Kafka, NIFI, HIVE, HUE, ...) - Support technique et applicatif sur les environnements BigData et périphériques ( HDP, CDP, NIFI, ELK, Talend, ...) - Accompagnement des projets pour migrer de HDP vers CDP - Implémentation de politiques de sécurité : Kerberos, Ranger, Knox - Gestion de configurations et Automatisation : Ansible, AWX - Métrologie, monitoring applicatif: ELK (Elasticsearch, Logstash, Kibana)
BigData Consultant - DevOps
La Poste Groupe
sept. 2021 - déc. 2021
4 mois
Environments/technologies : Cloudera CDP 7.1.5, Linux (RedHad 7.x) - Big Data Clusters installation automation - Implementation of Ansible roles for the Big Data components configuration - Making Big Data component Highly available (SPOFs elimination)
Big Data Architect
Banque de FranceFreelance
sept. 2020 - juil. 2021
11 mois
- harmonization of big data clusters configurations (DEV to PROD) - Stability and performance improvements of big data clusters - HA implementations of Big Data components (elimination of SPOFs) - Implementation of dedicated HIVE servers for BI teams - Participation in projects migration from HDP2.6 to CDP 7.x
BigData Senior Consultant - SRE - Cloudera Partner
ClouderaFreelance
nov. 2019 - mars 2020
5 mois
BigData Senior Consultant - Cloudera Partner - Audit of Big Data plateforms in order to migrate to HDP 3.1.x & CDP - implementation of POCs in order to validate that business uses cases continue to work in HDP 3 - installation of Cloudera HDP 3.1.4 / 3.1.5 clusters, Cloudera CDP 1.0 POC - OS upgrade : RedHat 6 to RedHat 7 - migrations procedures redaction: Spark/HIVE3 code migration using HWC , security policies migration of Storage base access to Ranger for HIVE 3 tables
BigData consultant - DevOps - Site reliability engineer
Societe Generale
oct. 2017 - oct. 2019
2 ans 1 mois
Environments/technologies : Hadoop Hortonworks, Jenkins, Ansible, Tower, Nexus, RedHat, Splunk, Elasticsearch. - BigData DEV & integration ENVs Administration: Ambari, HUE, RedHad(HDFS, YARN, Spark, Kafka, NIFI, HUE, ...) - Security policies implementation: Kerberos, openLDAP, Apache Ranger, Knox - Hadoop cluster migration to HDP 2.6.4 - VMs OS upgrade from RedHat 6/7 to 7.5/7.6 - Ansible modules creation for BigaData ENVs automated creation and security policies - Data science EDGE nodes implementation: Jupiter, Anaconda, python/R libs installation... - Implementation of a software factory for Continuous integration / Continuous delivery: Jenkins, Nexus, ansible - Control-M for Hadoop installation ( Big Data Cluster side ) - Configuration management and Delivery: Ansible, Tower - Methodologies, Mindset : Scrum, KANBAN, DevOps - POCs implementations - Metrology,data exploration, supervision: ELK (Elasticsearch, Logstash, Kibana), Splunk / Hunk, prometheus
DevOps
Reezocar
mars 2017 - août 2017
6 mois
Environments/technologies : AZURE Cloud, Linux, Docker, Docker Swarm, Jenkins, Apache, Nginx, NodeJs, ReactJS, MESOS, postgres, Elasticsearch, Varnish, Hbase - Implementation of a software factory - Continuous integration / delivery: Jenkins, Ansible, Sonarqube - Config management, deployments: Ansible, Terraform - Virtualization/cloud computing: Microsoft AZURE - Containers Orchestration: Docker Swarm, Apache MESOS, Marathon - Perfs : Jmeter, Varnish - Methodologies: DevOps, KANBAN - POCs Implementations - Metrology: ELK (Elasticsearch, Logstash, Kibana)
Groupe SNCF
janv. 2016 - juil. 2016
7 mois
DevOps
avr. 2016 - juil. 2016
4 mois
Environments / technologies: Linux (RedHat/Centos, Debian), Docker, Jenkins, git, Apache, python, PHP/Symfony, NodeJs, MongoDB, Angular, MESOS, C++. - Virtualization: VMWare, Docker - Config management, deployment: Puppet, Fabric - Docker containers orchestration (Apache MESOS, marathon) - Continuous Integration / Delivery: Jenkins, Rundeck, Fabric - Methodologies: DevOps, SCRUM, KANBAN - POCs Implementations - Metrology / logs Centralization : Logstash,Elasticsearch, Kibana, Graphite, Grafana, influxDB § Scheduling : RunDeck, crontab - Supervision : Centreon - Live system support (MCO)
DevOps
janv. 2016 - mai 2016
5 mois
Internal technical audit of services in order to migrate to Agile & Devops methodologies Environments / technologies : JAVA/J2EE, JBoss, tomcat , Oracle 11g, Linux RHEL, Docker, Jenkins, Puppet, VMWare - Run/QA/Dev processes audit - DevOps migration Roadmap - Organizations scenarios presentations in order to migrate to « feature-teams » - CMMI Aproach for mesuring services maturity in order to go toward Agile/DevOps mindsets - Audit in order to converge with VSCt (Voyage SNCF) o Software factory migration o DATACENTER migration o Teams & Organisational Evolutions o Technical Stacks evolutions
DevOps – BIG DATA – WEB –Virtualization
Club Med
janv. 2015 - oct. 2015
10 mois
Environments/technologies : Linux (RedHat, Ubuntu), Docker, Jenkins, GIT, Apache, Nginx, python, NodeJS, REDIS, MongoDB, OAUTH2, HTML5, ReactJS, PAAS Environment - Automatic virtualized ENVs BUILDs - Config management / deployment : Ansible - Docker containers orchestration POCs : (Kubernetes, Swarm, Apache MESOS+marathon) § API-FIRST/MOBILE-FIRST highly scallables - RESTFUL APIs, OAUTH2/OpenID-Connect Authentication - Continuous integration / delivery : Jenkins, ansible - Tests : unit tests, integration tests, functional tests (cucumber, JMeter, ...) - Methodologies : DevOps, SCRUM - Metrology : Logstash,Elasticsearch, Kibana - WEB performance Metrology: Sitespeed, Graphite, Grafana - Scheduling : IBM OPCon - Supervision : Nagios
IT Operations Engineer
Eiffage
janv. 2011 - janv. 2014
3 ans 1 mois
IT Operations Engineer - DSI EIFFAGE (Gennevilliers, France) - Release management of production applications - Change management & release management - Production standards compliance ensurance - Participation in supervision implementation : NAGIOS/Centreon § Metrology : CANOPSIS (solution CAPENSIS) - Scheduling : BMC Control-M 6.4, BMC Workload Automation 8 § Scripting : Shell UNIX, Powershell - Backup/restore : (NET BACKUP) - Storage management : SAN, LVM (linux/AIX) - Systems administration (windows 2003/8, linux RHCL, Aix 5/6) - Virtualization : VMWARE, CITRIX, HYPER-V - Databases : ORACLE 11gr2, Postgres, SQL server, INGRES, MongoDB § Inter applications data flows management : (SFTP CFT) - ETL : Datastage - Operations documentation writing (DEX, DAT, ...), night shift instructions § Nightly support (2011) - ITIL process: • Incident management / problem management • Change management
IT Operations Engineer
AXA Investment Managers
janv. 2010 - janv. 2011
1 an 1 mois
• technique support L2 of a hundred applications (investment) • win2003/IIS installation & configuration • .NET applications release management & Control-M automation • inter banking data exchange management :BFM (Batch Flow Manager) • Technical support of inter-applications data flows • ETL : SOPRA GENIO • RDBMS : Sybase SQL Server - MS SQL Server - oracle 10g
IT Operations Engineer
BNP Paribas
janv. 2008 - janv. 2010
2 ans 1 mois
IT Operations Engineer BNP PARIBAS (ITPS) (Montreuil, France) • Atlas implementation • Implementation of Back-office applications treatments BFI/IRS • Shell/PERL scripts Development & optimisation • Scheduling NSM/TNG • Applications release management & deployments & patch installation • CFT transferts management • System administration (LVM, Users accounts, unix,printer queues...) • Oracle Backup/restore management : (rman dumps import/exports) • Backup/Restore management: Tivoli Storage Manager • Websphere: implementations, deployments • Technical Environnement : Aix5.2-5.3, Windows XP/2003, NSM3.1/TNG, Oracle 8i-9i-10g, CFT, websphere
System administrator
MACIF
janv. 2004 - janv. 2005
1 an 1 mois
System Administrator AIX MACIF (Niort, France) • AIX System administration : AIX (4.2-5L), • Software installation & administration (oracle, Websphere, sybase SQL Server, IBM HTTP server) • KORN Shell scripting for servers sysadmin needs, • Integration of DEV teams deliverables/artefacts (websphere, oracle, sybase) • Technical Support for applications: websphere, oracle, sybase, tuxedo, MQSeries • Occasional controls on Mainframe (MVS) Technical Environnement : Aix, Websphere, oracle, sybase, tuxedo, Mqseries
IT Operations Analyst
MAAF Assurances
janv. 2003 - janv. 2004
1 an 1 mois
• marketing/infocentre applications integration • KORN Shell scripting • night support for products during commissioning (L2) • Shell scripts conversion from C-shell to korn shell • Heterogeneous environments normalization • Oracles integration & maintenances • Inter systems transfers management & automation : unix - mainframe Environment : Solaris, Linux, Oracle, Control-M
IT Operations Analyst
GEFCO
janv. 2002 - janv. 2003
1 an 1 mois
• Backup/Restore NETBACKUP • WAN/MAN network maintenance (3COM routers migration to CISCO routers) • Scheduling MAESTRO • Print services management : QMASTER • CFT files transfers management, IT data exchange (EDI) Technical Environnement : AIX, SOLARIS, netbackup, CFT, TBSM, TRC, cisco, NETWARE, vax-vms