Karim FARHANE
Senior Cloud & Data Architect | Azure Databricks
Salaire / Taux journalier
69340 Francheville, France
Freelance
Expertises
Langues
À propos
Introduction
CEO & Cloud Architect with 9+ years expertise in Data, AI & Cloud solutions across AWS, Azure, GCP. Led scalable Databricks migrations, hybrid architectures, and automated infrastructure deployments. Specialized in enterprise data platforms, FinOps optimization, and seamless cloud transformations for Fortune 500 clients.
Expérience de travail
Azure Databricks Expert
sept. 2023 - janv. 2025
1 an 5 mois
Building a Scalable and Secure Cloud Data Platform: ✔ Cloud Data Architecture – Designing a robust Cloud Data Foundation on Azure Databricks, ensuring scalability, security, and best practices. ✔ Private Link Standard Deployment – Implementing Azure Databricks Private Link Standard Deployment for enhanced security and network isolation. ✔ Automated Infrastructure Deployment – Leveraging Terraform and GitLab CI/CD to fully automate the deployment of the Databricks foundation on Azure. ✔ Access Management & Governance – Automating user and role management in Databricks using Terraform and Unity Catalog for fine-grained governance. ✔ Hadoop Migration to Databricks – Modernizing on-premise Hadoop workloads by migrating them to Azure Databricks, ensuring a seamless transition. ✔ Hive Metastore to Unity Catalog – Upgrading legacy Hive Metastore projects to Unity Catalog to enhance governance, security, and metadata management. ✔ Hybrid Data Platform – Building a hybrid architecture integrating on-premise Cloudera CDP and Azure Databricks using Azure Data Factory (ADF) replication and Delta Sharing. ✔ Monitoring & Supervision – Establishing centralized monitoring using Azure Monitor, seamlessly integrated with TrueSight for real-time observability. ✔ Security & Audit Logging – Integrating Azure Databricks security audit logs into Splunk for improved security monitoring and compliance. ✔ Master Data Management Integration – Connecting Unity Catalog with the enterprise Master Data Management (MDM) system, powered by Informatica. ✔ FinOps & Cost Governance – Implementing FinOps best practices, enabling chargeback mechanisms to optimize and allocate Azure Databricks costs efficiently. ✔ Cluster Policies & Chargeback for Projects – Defining and enforcing Databricks Cluster Policies to standardize configurations, control costs, and ensure compliance. Integrating chargeback mechanisms to accurately track and allocate Databricks compute expenses per project.
Cloudera
févr. 2019 - janv. 2024
5 ans
Senior Solutions Architect
août 2021 - janv. 2024
2 ans 6 mois
As a Solutions Architect at Cloudera, my main mission is to help clients design and implement effective big data solutions using Cloudera's technology stack aka CDP. This involves a range of responsibilities, including: 1. Understanding client requirements: As a solutions architect, I work with customers to understand their specific needs, challenges, and goals. I ask questions and gather informations in order to design solutions that will meet their unique requirements. 2. Designing big data architectures: Based on my understanding of the client's needs, I create and propose architectures that will effectively manage and process their big data. This could include designing data storage systems, data processing pipelines, and analytics platforms. 3. Demonstrating technical expertise: Solutions architects at Cloudera need to have deep technical expertise in big data technologies and be able to articulate that expertise to clients. I often participate in conducting demos, create proof-of-concept projects, and provide technical guidance to clients as needed. 4. Collaborating with other teams: As a Solutions architect, I work closely with sales, engineering, and product management teams to ensure that solutions are designed and implemented effectively. I make collaborate effectively with others and communicate technical concepts to non-technical stakeholders. 5. Finally, one of my principles is Customer Obsession: I Ensure that clients are successful in their use of Cloudera's technologies. This means working closely with clients to troubleshoot issues, provide guidance, and offer training as needed to ensure they get the most out of the solutions you design.
Solutions Architect
févr. 2019 - juil. 2021
2 ans 6 mois
Disaster Recovery Specialist
PRO BTP Groupe
févr. 2019 - mars 2019
2 mois
Nice, France
• Installation and securing of the Hadoop platform on VMware machines with a NetApp storage bay. • Writing of the DRP procedure. • Testing and simulation of DRP between the sites in Nice and Paris.
Harmonie Mutuelle
mai 2017 - janv. 2019
1 an 9 mois
Tech lead Big Data : Industrialisation de la "V360 Client"
janv. 2018 - janv. 2019
1 an 1 mois
Development of a framework for ingesting and processing multi-structured data: • Batch and streaming data ingestion. • Anonymization and encryption of sensitive data. • Data governance and integration with Atlas/Cloudera Navigator. • Data historization & rollback.
Développeur Big Data - Construction d'un datalab
mai 2017 - janv. 2019
1 an 9 mois
Région de Paris, France
Consultant SI
Sentelis
nov. 2015 - janv. 2019
3 ans 3 mois
Développeur Big Data
Covéa
janv. 2016 - mai 2017
1 an 5 mois
Industrialisation d'un socle technique "Data Centric" Covea: - Centralisation de logs de chaque enseigne d’un cluster Hadoop avec la Stack ELK (Elasticsearch, Logstash, Kibana), et développement de Dashboard d’activités. - Automatisation d’installation logiciels, configuration et tests d'infrastructure via Chef - Automatisation de création et livraison de cluster Hadoop en utilisant l’API CM - Administration et support Cloudera - Provisionnement de machines Redhat/CentOS via satellite - Management d’identité avec FreeIPA/AD - Etude et mise en place du Plan de Reprise d’Activité (PRA) pour la plateforme BigData d'une enseigne - Intégration et déploiement continue du code infra et socle logique (DevOps) - Participation à la sécurisation du Cluster Hadoop via Kerberos - Réalisation d'un POC de "DataLoader" codé en Scala sur du Spark
Architecte Cloud
Orange
mars 2015 - oct. 2015
8 mois
35510 Cesson-Sévigné, France
Cesson Sévigné – développement d’une application de supervision réseau Etude et implémentation d’une collecte de métriques sur une architecture de type IT basée sur OpenStack: 1) Conception et mise en place d'une architecture Cloud basée sur OpenStack 2) Implémentation en Python d’un agent Ceilometer remontant des KPIs réseaux des nœuds de calculs. 3) Déploiement d’applications avec heat et passage à l’échelle _ autoscaling Heat/Ceilometer 4) Réalisation d'un dashbord visualisant la charge d'un datacenter en temps réel 5) Préparation d'un PoC pour la Convergence de Gateway de réseau fixe et mobile (NGPoP basé OpenStack) Technologies : OpenStack, Python, XML/JSON, Vagrant-VirtualBox, OpenvSwitch, OpenFlow, mininet, Git
Data Scientist - Machine Learning
Astellia
oct. 2014 - mars 2015
6 mois
Rennes, France
Projet industriel en partenariat avec Astellia. Concevoir un algorithme basé sur les séries temporelles pour la détection d’anomalies du réseau cellulaire: 1) Rédaction d'un cahier de charges destiné au client 2) Proposition d'un algorithme de prévision: ARIMA (Supervised Learning Algorithm) 3) Mise en place d'un cluster Hadoop et utilisation de MapReduce 4) Conception et développement d'une plateforme dédiée aux tests Outils: R, Matlab, ARIMA Model, Hadoop
Développement d’un logiciel et interface graphique
Uniporc Ouest
juil. 2014 - oct. 2014
4 mois
Région de Saint-Brieuc, France
Concevoir et développer un nouvel outil informatique de capture d’informations issues de sondes et d’une interface IHM dans un environnement de production. Les informations recueillies sont stockées en base de données MySQL
Formation
IMT Atlantique
Diplôme d'ingénieur
2012 - 2015
4 ans
Université de Bretagne Occidentale
Master 2 (M2)
2012 - 2014
3 ans
Lycée Moulay Youssef
Classes préparatoires aux grandes écoles
2010 - 2012
3 ans
Lycée Technique Taza
Baccalauréat Scientifique
2009 - 2010
2 ans
Membre du parlement de l'enfant au Maroc
2005 - 2010
5 ans 10 mois