Hafsi Ahmed

𝗠𝗶𝘀𝘀𝗶𝗼𝗻 𝗮𝘁 𝗕𝗽𝗶𝗳𝗿𝗮𝗻𝗰𝗲 - 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 𝗖𝗼𝗿𝗲 𝗕𝗮𝗻𝗸𝗶𝗻𝗴 𝗦𝘆𝘀𝘁𝗲𝗺: We design and maintain scalable data pipelines using AWS Glue and PySpark to deliver high-quality data to Bpifrance's business units. Leveraging our “Data Hunting” methodology, we source and integrate data from Open Data and top external providers. 𝗞𝗲𝘆 𝗖𝗼𝗻𝘁𝗿𝗶𝗯𝘂𝘁𝗶𝗼𝗻𝘀: * Building ETL pipelines with AWS Glue to transform raw data into insights. * Enhancing data quality with Athena, Datadog, and CloudWatch (monitoring). * Optimizing SQL queries for better performance. * Integrating Kafka for real-time data streaming. * Automating CI/CD pipelines with Terraform (Atlantis) and Jenkins. * Ingesting data into MongoDB and S3. * Creating custom CloudWatch and Datadog monitoring dashboards. * Orchestrating workflows with Airflow. * Writing unit tests using PyTest (80%+ coverage). 𝗦𝗸𝗶𝗹𝗹𝘀 & 𝗘𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲: 𝗧𝗲𝗰𝗵 𝗦𝘁𝗮𝗰𝗸: Python, PySpark, MongoDB, AWS Glue, Kafka, Jenkins, SQL, Terraform (Atlantis). 𝗣𝗹𝗮𝘁𝗳𝗼𝗿𝗺𝘀: AWS, GitLab, Jira, Airflow.